00000001:02000400:0.0F:1787031966.588217:0:2956:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing set_hostid 00000001:02000400:0.0:1787031986.738511:0:3178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787031988.834703:0:3222:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 471 MB/s 00000001:01000000:0.0:1787031989.084390:0:3222:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1231 MB/s 00000001:01000000:2.0F:1787031989.334466:0:3222:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5287 MB/s 00000020:02000000:0.0:1787031990.119970:0:3270:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.55_1_g50984fb 00000400:02000000:2.0:1787031991.237859:0:3286:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.201.148@tcp [8/256/0/180] 00008000:02000000:3.0:1787031994.744195:0:3435:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1787032051.822980:0:5246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787032062.451170:0:5778:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787032062.451177:0:5778:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787032062.451327:0:5778:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000b2a8b51e 00000080:02000400:3.0:1787032062.451339:0:5778:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787032062.462551:0:5778:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787032062.462565:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787032062.462608:0:5778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000849dfde8) 00000020:00000080:3.0:1787032062.462629:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787032062.522473:0:5778:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787032062.522850:0:5778:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787032062.556537:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787032062.556575:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787032062.556595:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787032062.556640:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787032062.556661:0:5778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787032062.557008:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787032062.557017:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787032062.557029:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1e9528 00000020:01000004:2.0:1787032062.557037:0:5778:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787032062.557043:0:5778:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787032062.557048:0:5778:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b2a8b51e from MGS 00000020:01000004:2.0:1787032062.557053:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787032062.557106:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000074f995a7) 00000020:00000080:2.0:1787032062.557120:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787032062.557243:0:5778:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b2a8b51e from MGS, refs=2 00080000:01000000:2.0:1787032062.557249:0:5778:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787032062.557254:0:5778:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1e9536 00000100:00100000:2.0:1787032062.557351:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787032062.557482:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787032062.557488:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787032062.559458:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787032062.559471:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787032062.560353:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032062.560534:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787032062.560541:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787032062.561445:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787032062.561454:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787032062.561769:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787032062.561775:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787032062.562729:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032062.562733:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032062.562735:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032062.562993:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032062.562995:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032062.562997:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032062.563751:0:5778:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787032062.571427:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787032062.813289:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2415 MB/s 00000001:01000000:1.0:1787032063.065125:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2635 MB/s 00000001:01000000:1.0:1787032063.316202:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 350 MB/s 00000001:01000000:3.0:1787032063.566094:0:5778:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 707 MB/s 00080000:10000000:3.0:1787032063.582999:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787032063.616463:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787032063.616496:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787032063.616499:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1787032063.617518:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787032063.624741:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787032063.629651:0:5778:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787032063.629721:0:5778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787032063.629948:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787032063.629971:0:5778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787032063.630523:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787032063.630685:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787032063.630691:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787032063.640672:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787032063.640691:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787032063.641062:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787032063.641435:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787032063.652980:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787032063.653017:0:5778:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.148@tcp' 00000020:01000004:2.0:1787032063.653019:0:5778:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787032063.653146:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.148@tcp (typ=mgc) 00000020:00000080:2.0:1787032063.653160:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.148@tcp (00000000227331f9) 00000020:00000080:2.0:1787032063.653177:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787032063.653269:0:5778:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a3a0ad66@MGC192.168.201.148@tcp: add connection 192.168.201.148@tcp at head 00010000:00010000:2.0:1787032063.653444:0:5778:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.148@tcp-0 is initialized 00000040:01000000:2.0:1787032063.653453:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.148@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787032063.653725:0:5794:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787032063.653752:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.148@tcp (uuid 0402f217-6678-4505-97bf-ca0cb32c7313) 00000020:00000080:2.0:1787032063.653765:0:5778:0:(genops.c:1406:class_connect()) connect: client 0402f217-6678-4505-97bf-ca0cb32c7313, cookie 0xcd047797ef1e9544 00000100:00080000:2.0:1787032063.653775:0:5778:0:(import.c:510:import_select_connection()) MGC192.168.201.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787032063.653780:0:5778:0:(import.c:624:import_select_connection()) MGC192.168.201.148@tcp: import 00000000a3a0ad66 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:2.0:1787032063.653821:0:5778:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000038f9c9b6 x1873838856994944/t0(0) o250->MGC192.168.201.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787032063.653848:0:5778:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0402f217-6678-4505-97bf-ca0cb32c7313->MGS 00000020:01000004:2.0:1787032063.653867:0:5778:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787032063.653891:0:5778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787032063.653900:0:5778:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ac1eb23b) 00000020:00000080:2.0:1787032063.653909:0:5778:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787032063.661234:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038f9c9b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0402f217-6678-4505-97bf-ca0cb32c7313:3301:1873838856994944:0@lo:250: 00000100:00100000:0.0:1787032063.661355:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787032063.661698:0:5793:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1787032063.661739:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856994944 00000100:00100000:0.0:1787032063.661747:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856994944 00000100:00100000:0.0:1787032063.661799:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032063.661805:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027197da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3301:x1873838856994944:12345-0@lo:250: 00010000:00080000:0.0:1787032063.661833:0:5791:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 0402f217-6678-4505-97bf-ca0cb32c7313@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1787032063.661878:0:5791:0:(genops.c:1406:class_connect()) connect: client 0402f217-6678-4505-97bf-ca0cb32c7313, cookie 0xcd047797ef1e9552 00000100:00080000:0.0:1787032063.662252:0:5791:0:(import.c:65:import_set_state_nolock()) 0000000080cb59b0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032063.662316:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027197da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+5:3301:x1873838856994944:12345-0@lo:250: Request processed in 509us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032063.662323:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032063.662361:0:3301:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787032063.662369:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.148@tcp: connect to target with instance 0 00000100:00080000:0.0:1787032063.662375:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787032063.662380:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787032063.662382:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000a3a0ad66 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787032063.662385:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787032063.662388:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787032063.662392:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038f9c9b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0402f217-6678-4505-97bf-ca0cb32c7313:3301:1873838856994944:0@lo:250: 00000100:00100000:2.0:1787032063.687537:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787032063.687726:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787032063.687731:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787032063.688775:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787032063.688785:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787032063.689487:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787032063.689494:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787032063.690368:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787032063.690548:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787032063.690554:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787032063.691242:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787032063.691250:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787032063.758917:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787032063.761310:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787032063.761321:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787032063.767379:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787032063.767450:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787032063.772313:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787032063.772502:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787032063.772511:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787032063.773365:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787032063.773376:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787032063.780505:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787032063.780712:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787032063.780719:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787032063.789621:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787032063.789641:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787032063.790408:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787032063.790566:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787032063.790572:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787032063.791121:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787032063.791129:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787032063.830762:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787032063.830940:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787032063.830953:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787032063.837582:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787032063.837599:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787032063.838904:0:5778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787032063.838915:0:5778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787032063.840339:0:5778:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787032063.840368:0:5778:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787032063.840374:0:5778:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787032063.840514:0:5778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787032063.840549:0:5778:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.148@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787032063.840554:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787032063.840556:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787032063.840561:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032063.840562:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032063.840563:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032063.840564:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032063.840565:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787032063.840566:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787032063.840568:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787032063.840569:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787032063.840570:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032063.840572:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787032063.840574:0:5778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787032063.840576:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787032063.840577:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787032063.840578:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032063.840578:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032063.840579:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032063.840580:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032063.840581:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787032063.840582:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787032063.840583:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787032063.840583:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787032063.840584:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032063.840585:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787032063.840622:0:5778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787032063.840642:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f00391 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995072:0@lo:253: 00000100:00100000:3.0:1787032063.840721:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032063.840777:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000009c61b03b going to sleep for 11 seconds 00000100:00100000:1.0:1787032063.840864:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856995072 00000100:00100000:1.0:1787032063.840872:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856995072 00000100:00100000:1.0:1787032063.840933:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787032063.840942:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b1f9b0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+5:5778:x1873838856995072:12345-0@lo:253: 20000000:01000000:1.0:1787032063.841002:0:5792:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787032063.841006:0:5792:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787032063.841442:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787032063.841655:0:5792:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787032063.841978:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787032063.848744:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787032063.850656:0:5792:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787032063.850664:0:5792:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787032063.850670:0:5792:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787032063.850673:0:5792:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787032063.850690:0:5792:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787032063.850963:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787032063.851330:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787032063.851344:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787032063.851393:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787032063.851446:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787032063.852183:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787032063.852311:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787032063.852331:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787032063.852403:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787032063.852412:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787032063.852446:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787032063.852454:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787032063.853333:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787032063.853404:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787032063.853456:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787032063.854133:0:5792:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787032063.854170:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787032063.854425:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787032063.854440:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787032063.855192:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787032063.855257:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787032063.855315:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787032063.855331:0:5792:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787032063.855429:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787032063.855437:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787032063.855599:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787032063.855639:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787032063.855671:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787032063.855680:0:5792:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787032063.855778:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787032063.855787:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787032063.855817:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787032063.855845:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787032063.857228:0:5792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787032063.857325:0:5792:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787032063.857334:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787032063.861619:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787032063.862179:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787032063.862217:0:5792:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.148@tcp for mdt 20000000:01000000:1.0:1787032063.862219:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.148@tcp (null) (null) (null) 00000040:00080000:1.0:1787032063.862273:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787032063.862280:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787032063.862309:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787032063.862316:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.148@tcp (null) (null) 00000040:00080000:1.0:1787032063.862360:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787032063.862370:0:5792:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787032063.862403:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787032063.862458:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787032063.862522:0:5792:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787032063.862525:0:5792:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787032063.862530:0:5792:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787032063.862542:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787032063.862545:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787032063.862573:0:5792:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787032063.862575:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787032063.863340:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787032063.863585:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787032063.863627:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787032063.863700:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787032063.863713:0:5792:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787032063.863715:0:5792:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787032063.864271:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787032063.864495:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787032063.864534:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787032063.864567:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787032063.864580:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787032063.864583:0:5792:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787032063.864587:0:5792:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787032063.864589:0:5792:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787032063.864594:0:5792:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787032063.864600:0:5792:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787032063.864917:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787032063.865260:0:5792:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787032063.879140:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787032063.879196:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787032063.879282:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787032063.879303:0:5792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787032063.879323:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879339:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879348:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879368:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879374:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879380:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879386:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000892326f1 already unused, calling callback (00000000a0af42d5) 00010000:00010000:3.0:1787032063.879389:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879396:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879409:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879417:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032063.879422:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000892326f1/0xcd047797ef1e9559 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787032063.879439:0:5792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787032064.089254:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b1f9b0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+5:5778:x1873838856995072:12345-0@lo:253: Request processed in 248305us (248525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032064.089270:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032064.089450:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f00391 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995072:0@lo:253: 10000000:01000000:0.0:1787032064.089466:0:5778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787032064.089470:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787032064.089472:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787032064.089473:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032064.089474:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787032064.089475:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032064.089476:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032064.089478:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787032064.089479:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787032064.089481:0:5778:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787032064.089482:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032064.089484:0:5778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787032064.089503:0:5778:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b2a8b51e from lustre-MDT0000 10000000:01000000:0.0:1787032064.089526:0:5778:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787032064.089529:0:5778:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787032064.089533:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99cdc7654d40 10000000:01000000:0.0:1787032064.089537:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787032064.089544:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99cdc7654d40 from 1 10000000:01000000:0.0:1787032064.089546:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787032064.089591:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.089602:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.089610:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032064.089702:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a4b834ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995200:0@lo:101: 00000100:00100000:0.0:1787032064.089737:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.089881:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000006f6aca2e going to sleep for 11 seconds 00000100:00100000:1.0:1787032064.092766:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856995200 00000100:00100000:1.0:1787032064.092781:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856995200 00000100:00100000:1.0:1787032064.092844:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787032064.092853:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e2c7f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+5:5778:x1873838856995200:12345-0@lo:101: 00010000:00010000:1.0:1787032064.092870:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032064.092901:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9560 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.092923:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.092930:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.092936:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e3f4db0, rc 0) 00000100:00100000:1.0:1787032064.093100:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e2c7f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+6:5778:x1873838856995200:12345-0@lo:101: Request processed in 247us (3361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032064.093107:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787032064.094864:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a4b834ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995200:0@lo:101: 00010000:00010000:3.0:1787032064.094890:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032064.094917:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032064.095721:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995328:0@lo:501: 00000100:00100000:2.0:1787032064.095797:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032064.095901:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7565ba8 going to sleep for 11 seconds 00000100:00100000:1.0:1787032064.095983:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856995328 00000100:00100000:1.0:1787032064.095990:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856995328 00000100:00100000:1.0:1787032064.096095:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787032064.096103:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033b9993f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+6:5778:x1873838856995328:12345-0@lo:501: 00000100:00100000:1.0:1787032064.096375:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033b9993f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+6:5778:x1873838856995328:12345-0@lo:501: Request processed in 273us (577us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787032064.096383:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032064.096455:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995328:0@lo:501: 10000000:01000000:2.0:1787032064.096493:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787032064.096516:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.096525:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032064.096534:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cde4b73800 10000000:01000000:2.0:1787032064.096538:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787032064.096542:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cde4b73800 10000000:01000000:2.0:1787032064.096544:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787032064.096546:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99cde4b73800 from 1 10000000:01000000:2.0:1787032064.096548:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787032064.096573:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000ddd6d149/0xcd047797ef1e956e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.096581:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000ddd6d149/0xcd047797ef1e956e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.096589:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000ddd6d149/0xcd047797ef1e956e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032064.096607:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995456:0@lo:101: 00000100:00100000:2.0:1787032064.096656:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032064.097011:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7565ba8 going to sleep for 11 seconds 00000100:00100000:0.0:1787032064.097050:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856995456 00000100:00100000:0.0:1787032064.097055:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856995456 00000100:00100000:0.0:1787032064.097306:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032064.097313:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000befb36ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+6:5778:x1873838856995456:12345-0@lo:101: 00010000:00010000:0.0:1787032064.097323:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032064.097340:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004609d34e/0xcd047797ef1e9575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e956e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.097361:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004609d34e/0xcd047797ef1e9575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e956e expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.097371:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004609d34e/0xcd047797ef1e9575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e956e expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.097379:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004609d34e, rc 0) 00000100:00100000:0.0:1787032064.097425:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000befb36ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+7:5778:x1873838856995456:12345-0@lo:101: Request processed in 113us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032064.097432:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787032064.097564:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995456:0@lo:101: 00010000:00010000:2.0:1787032064.097583:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000ddd6d149/0xcd047797ef1e956e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.097591:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000ddd6d149/0xcd047797ef1e956e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032064.097605:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787032064.097619:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 00000000ddd6d149/0xcd047797ef1e956e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.097625:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 00000000ddd6d149/0xcd047797ef1e956e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032064.097638:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787032064.097642:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787032064.097647:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cde4b73800 10000000:01000000:2.0:1787032064.097649:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787032064.097652:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787032064.097654:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787032064.097671:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.097677:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.097684:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032064.097707:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995584:0@lo:101: 00000100:00100000:2.0:1787032064.097737:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032064.097759:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7565ba8 going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.097776:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856995584 00000100:00100000:2.0:1787032064.097780:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856995584 00000100:00100000:2.0:1787032064.097809:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787032064.097814:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001d918f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+7:5778:x1873838856995584:12345-0@lo:101: 00010000:00010000:2.0:1787032064.097821:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032064.097829:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e957c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.097841:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e957c expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.097848:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e957c expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.097853:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000af5a10dd, rc 0) 00000100:00100000:2.0:1787032064.097880:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001d918f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+8:5778:x1873838856995584:12345-0@lo:101: Request processed in 66us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032064.097886:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787032064.097917:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995584:0@lo:101: 00010000:00010000:2.0:1787032064.097926:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.097932:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032064.097980:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995712:0@lo:501: 00000100:00100000:2.0:1787032064.098004:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032064.098016:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7565ba8 going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.098028:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856995712 00000100:00100000:2.0:1787032064.098032:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856995712 00000100:00100000:2.0:1787032064.098051:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787032064.098056:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c722ebb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+8:5778:x1873838856995712:12345-0@lo:501: 00000100:00100000:2.0:1787032064.098320:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c722ebb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:5778:x1873838856995712:12345-0@lo:501: Request processed in 263us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032064.098327:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787032064.098360:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995712:0@lo:501: 00000100:00100000:2.0:1787032064.098386:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995840:0@lo:503: 00000100:00100000:2.0:1787032064.098426:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032064.098439:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a7565ba8 going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.098451:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856995840 00000100:00100000:2.0:1787032064.098454:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856995840 00000100:00100000:2.0:1787032064.098490:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787032064.098495:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0c84f86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:5778:x1873838856995840:12345-0@lo:503: 00000100:00100000:2.0:1787032064.098635:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0c84f86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:5778:x1873838856995840:12345-0@lo:503: Request processed in 140us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032064.098642:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787032064.098682:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009421d9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856995840:0@lo:503: 00000100:00100000:0.0:1787032064.099367:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006e982b95 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:5820:1873838856995968:0@lo:502: 00000100:00100000:0.0:1787032064.099412:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.099439:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c1856f75 going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.099524:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856995968 00000100:00100000:2.0:1787032064.099528:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856995968 00000100:00100000:2.0:1787032064.099566:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787032064.099572:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000339bdb60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:5820:x1873838856995968:12345-0@lo:502: 00000100:00100000:2.0:1787032064.099883:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000339bdb60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:5820:x1873838856995968:12345-0@lo:502: Request processed in 311us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032064.099890:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787032064.100141:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006e982b95 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:5820:1873838856995968:0@lo:502: 00000020:01000000:0.0:1787032064.100166:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032064.100184:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032064.100186:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787032064.100191:0:5820:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787032064.100203:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787032064.100223:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000dcc35b47) 00000020:00000080:0.0:1787032064.100241:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787032064.100247:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787032064.100318:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787032064.100335:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1e9591 00000020:00000080:0.0:1787032064.100619:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787032064.100624:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032064.100628:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032064.100629:0:5820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787032064.100699:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032064.100705:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032064.100707:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787032064.100711:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787032064.100718:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009c428198) 00000020:00000080:0.0:1787032064.100729:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787032064.100733:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787032064.100734:0:5820:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787032064.100737:0:5820:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787032064.100743:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787032064.100789:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b2a8b51e from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787032064.100800:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cdd2d77b) 00000020:00000080:0.0:1787032064.100807:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787032064.100851:0:5820:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787032064.100856:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1e95a6 00000020:00000080:0.0:1787032064.100942:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787032064.100947:0:5820:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787032064.100951:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd047797ef1e95ad 00080000:01000000:0.0:1787032064.100956:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787032064.100959:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1e95b4 00080000:10000000:0.0:1787032064.101592:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787032064.101867:0:5820:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787032064.107988:0:5820:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787032064.203051:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787032064.203807:0:5820:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787032064.207290:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787032064.207609:0:5820:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787032064.272272:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001c612562) 00000020:00000080:2.0:1787032064.272296:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787032064.272381:0:5820:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787032064.272388:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1e95c2 00000020:00000080:0.0:1787032064.273688:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787032064.276449:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032064.328363:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787032064.352150:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032064.392981:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032064.442606:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032064.500527:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787032064.550997:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd047797ef1e95c9 00000020:00000080:0.0:1787032064.552511:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787032064.552526:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032064.552532:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032064.552535:0:5820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787032064.552538:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032064.552541:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032064.552542:0:5820:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787032064.552545:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787032064.552546:0:5820:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787032064.552549:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032064.552551:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032064.552552:0:5820:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787032064.552554:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032064.552559:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032064.552560:0:5820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787032064.552564:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787032064.552601:0:5820:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787032064.552654:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006e982b95 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:5820:1873838856996096:0@lo:502: 00000100:00100000:0.0:1787032064.552736:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.552805:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c404a61 going to sleep for 11 seconds 00000100:00100000:1.0:1787032064.553021:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856996096 00000100:00100000:1.0:1787032064.553028:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856996096 00000100:00100000:1.0:1787032064.553100:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787032064.553109:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c099026 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+9:5820:x1873838856996096:12345-0@lo:502: 00000100:00100000:1.0:1787032064.553455:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c099026 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+9:5820:x1873838856996096:12345-0@lo:502: Request processed in 347us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032064.553476:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787032064.553540:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006e982b95 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:5820:1873838856996096:0@lo:502: 00000020:01000000:2.0:1787032064.553567:0:5820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787032064.553573:0:5820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032064.553574:0:5820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787032064.553578:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787032064.553752:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787032064.553769:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787032064.553825:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.553836:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032064.553856:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cde4b73800 from 1 10000000:01000000:0.0:1787032064.553859:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787032064.553886:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.553892:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.553900:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032064.553912:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075de7985 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996224:0@lo:101: 00000100:00100000:0.0:1787032064.553941:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.553971:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c404a61 going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.554279:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856996224 00000100:00100000:2.0:1787032064.554285:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856996224 00000100:00100000:2.0:1787032064.554321:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787032064.554327:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089913eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:5778:x1873838856996224:12345-0@lo:101: 00010000:00010000:2.0:1787032064.554346:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032064.554358:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e95d0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.554379:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.554388:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.554395:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090813d5c, rc 0) 00000100:00100000:2.0:1787032064.554435:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089913eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+10:5778:x1873838856996224:12345-0@lo:101: Request processed in 108us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032064.554442:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787032064.554697:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075de7985 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996224:0@lo:101: 00010000:00010000:3.0:1787032064.554713:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032064.554721:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032064.555329:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996352:0@lo:256: 00000100:00100000:3.0:1787032064.555375:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032064.555459:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f6b5cd0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032064.555700:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856996352 00000100:00100000:0.0:1787032064.555706:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856996352 00000100:00100000:0.0:1787032064.555775:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787032064.555782:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056d69e0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+10:5778:x1873838856996352:12345-0@lo:256: 20000000:01000000:0.0:1787032064.555798:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787032064.555803:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787032064.555880:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056d69e0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+10:5778:x1873838856996352:12345-0@lo:256: Request processed in 99us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032064.555887:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787032064.555952:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996352:0@lo:256: 10000000:01000000:3.0:1787032064.556695:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787032064.556758:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032064.556769:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032064.556777:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cde4b73800 from 1 10000000:01000000:3.0:1787032064.556779:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787032064.556808:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032064.556813:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032064.556825:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032064.556836:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996480:0@lo:101: 00000100:00100000:3.0:1787032064.556862:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032064.556888:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f6b5cd0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032064.556905:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856996480 00000100:00100000:0.0:1787032064.556910:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856996480 00000100:00100000:0.0:1787032064.556969:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787032064.556974:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0588628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+10:5778:x1873838856996480:12345-0@lo:101: 00010000:00010000:0.0:1787032064.556982:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032064.556996:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e95de expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.557009:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e95de expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.557015:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e95de expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.557020:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ad395f9, rc 0) 00000100:00100000:0.0:1787032064.557047:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0588628 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:5778:x1873838856996480:12345-0@lo:101: Request processed in 73us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032064.557053:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787032064.557092:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996480:0@lo:101: 00010000:00010000:3.0:1787032064.557105:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032064.557113:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032064.557154:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996608:0@lo:501: 00000100:00100000:3.0:1787032064.557172:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032064.557203:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f6b5cd0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032064.557207:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856996608 00000100:00100000:0.0:1787032064.557212:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856996608 00000100:00100000:0.0:1787032064.557261:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787032064.557266:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007abef9bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:5778:x1873838856996608:12345-0@lo:501: 00000100:00100000:0.0:1787032064.557697:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007abef9bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:5778:x1873838856996608:12345-0@lo:501: Request processed in 430us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032064.557704:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787032064.557730:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996608:0@lo:501: 00000100:00100000:3.0:1787032064.557755:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996736:0@lo:503: 00000100:00100000:3.0:1787032064.557790:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032064.558051:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856996736 00000100:00100000:2.0:1787032064.558056:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856996736 00000100:00100000:3.0:1787032064.558058:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f6b5cd0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032064.558128:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787032064.558135:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c96bb0af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:5778:x1873838856996736:12345-0@lo:503: 00000040:00080000:0.0:1787032064.558168:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787032064.558230:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c96bb0af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:5778:x1873838856996736:12345-0@lo:503: Request processed in 97us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032064.558235:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787032064.558329:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996736:0@lo:503: 00000040:00080000:1.0:1787032064.562478:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787032064.565685:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787032064.565716:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787032064.565739:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.565770:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032064.565818:0:5778:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787032064.565821:0:5778:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cde4b73800 10000000:01000000:0.0:1787032064.565824:0:5778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cde4b73800 10000000:01000000:0.0:1787032064.565828:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787032064.565834:0:5778:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cde4b73800 from 1 10000000:01000000:0.0:1787032064.565837:0:5778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787032064.565873:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.565881:0:5778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.565890:0:5778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032064.565914:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006328ff4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996864:0@lo:101: 00000100:00100000:0.0:1787032064.565985:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.566037:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b27cf91c going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.566136:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856996864 00000100:00100000:2.0:1787032064.566144:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856996864 00000100:00100000:2.0:1787032064.566182:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787032064.566198:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd80033a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:5778:x1873838856996864:12345-0@lo:101: 00010000:00010000:2.0:1787032064.566212:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032064.566225:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e95ec expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.566249:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.566258:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.566277:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1dfdcdb, rc 0) 00000100:00100000:0.0:1787032064.566416:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd80033a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5778:x1873838856996864:12345-0@lo:101: Request processed in 219us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032064.566423:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787032064.566507:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006328ff4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996864:0@lo:101: 00010000:00010000:1.0:1787032064.566521:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.566529:0:5778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032064.566594:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054bb47ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996992:0@lo:501: 00000100:00100000:1.0:1787032064.566753:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032064.566781:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 000000008135d5b7 going to sleep for 11 seconds 00000100:00100000:3.0:1787032064.566807:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856996992 00000100:00100000:3.0:1787032064.566812:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856996992 00000100:00100000:3.0:1787032064.566850:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787032064.566856:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0424f3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:5778:x1873838856996992:12345-0@lo:501: 00000100:00100000:3.0:1787032064.567154:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0424f3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:5778:x1873838856996992:12345-0@lo:501: Request processed in 298us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032064.567161:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787032064.567204:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054bb47ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856996992:0@lo:501: 00000100:00100000:0.0:1787032064.567235:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d475070a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856997120:0@lo:503: 00000100:00100000:0.0:1787032064.567278:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.567319:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b27cf91c going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.567425:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856997120 00000100:00100000:2.0:1787032064.567430:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856997120 00000100:00100000:2.0:1787032064.567453:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787032064.567458:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a396c1bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5778:x1873838856997120:12345-0@lo:503: 00000100:00100000:2.0:1787032064.567783:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a396c1bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5778:x1873838856997120:12345-0@lo:503: Request processed in 324us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032064.567790:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787032064.568131:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d475070a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856997120:0@lo:503: 00000100:00100000:3.0:1787032064.568494:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:5825:1873838856997248:0@lo:502: 00000100:00100000:3.0:1787032064.568537:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032064.568566:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b7628e65 going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.568699:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856997248 00000100:00100000:2.0:1787032064.568704:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856997248 00000100:00100000:2.0:1787032064.568751:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787032064.568756:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034fb1e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5825:x1873838856997248:12345-0@lo:502: 00000100:00100000:2.0:1787032064.568967:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034fb1e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5825:x1873838856997248:12345-0@lo:502: Request processed in 211us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032064.568975:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787032064.569140:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087bde2b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:5825:1873838856997248:0@lo:502: 00000020:01000004:0.0:1787032064.569202:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787032064.569216:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000056d37f9e) 00000020:00000080:0.0:1787032064.569236:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787032064.569400:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b2a8b51e from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787032064.569404:0:5825:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b2a8b51e from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787032064.569406:0:5825:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b2a8b51e 4 00010000:00080000:0.0:1787032064.569432:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004b7963b7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.148@tcp at head 00010000:00010000:0.0:1787032064.571000:0:5825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787032064.571137:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787032064.571168:0:5825:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787032064.571179:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd047797ef1e9601 00000100:00080000:0.0:1787032064.571198:0:5825:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787032064.571203:0:5825:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004b7963b7 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:0.0:1787032064.571234:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d475070a x1873838856997376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787032064.571262:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787032064.571437:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d475070a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838856997376:0@lo:38: 00000100:00100000:2.0:1787032064.571513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.571995:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856997376 00000100:00100000:0.0:1787032064.572004:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856997376 00000100:00100000:0.0:1787032064.572041:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032064.572047:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009421d9ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1873838856997376:12345-0@lo:38: 00000100:00100000:0.0:1787032064.572172:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009421d9ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1873838856997376:12345-0@lo:38: Request processed in 123us (659us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787032064.572179:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787032064.572517:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787032064.572525:0:3301:0:(import.c:65:import_set_state_nolock()) 000000004b7963b7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787032064.572529:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787032064.572531:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d475070a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838856997376:0@lo:38: 00000100:00100000:0.0:1787032064.572605:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000032d024d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:5825:1873838856997504:0@lo:502: 00000100:00100000:0.0:1787032064.572734:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032064.572761:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856997504 00000100:00100000:0.0:1787032064.572764:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c404a61 going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.572765:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856997504 00000100:00100000:2.0:1787032064.572801:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787032064.572807:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d67720a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5825:x1873838856997504:12345-0@lo:502: 00000100:00100000:2.0:1787032064.573013:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d67720a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5825:x1873838856997504:12345-0@lo:502: Request processed in 206us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032064.573020:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787032064.574950:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000032d024d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:5825:1873838856997504:0@lo:502: 00000040:00080000:2.0:1787032064.574998:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787032064.576367:0:5778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787032064.576394:0:5778:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787032064.576419:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.576431:0:5778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787032064.576493:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787032064.576495:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787032064.576496:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032064.576497:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032064.576498:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032064.576499:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032064.576501:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787032064.576502:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787032064.576503:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787032064.576504:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787032064.576506:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032064.576507:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787032064.576510:0:5778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787032064.576513:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787032064.576514:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787032064.576515:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032064.576516:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032064.576516:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032064.576517:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032064.576518:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787032064.576519:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787032064.576520:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787032064.576521:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787032064.576522:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032064.576523:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787032064.576548:0:5778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787032064.576569:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077c2498f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856997632:0@lo:253: 00000100:00100000:0.0:1787032064.576714:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.576758:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set 00000000068a1ee7 going to sleep for 11 seconds 00000100:00100000:2.0:1787032064.577231:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856997632 00000100:00100000:2.0:1787032064.577238:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856997632 00000100:00100000:2.0:1787032064.577320:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787032064.577328:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006461a663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5778:x1873838856997632:12345-0@lo:253: 20000000:01000000:2.0:1787032064.577372:0:5791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787032064.577385:0:5791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787032064.635362:0:5791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787032064.635385:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787032064.635493:0:5813:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787032064.635498:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787032064.635517:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.635537:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.635545:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.635584:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032064.635599:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 12 pid: 5790 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032064.635613:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f8a06ff pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1873838856997760:0@lo:104: 00000100:00100000:0.0:1787032064.635679:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032064.635757:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set 0000000064231f35 going to sleep for 11 seconds 00000100:00100000:1.0:1787032064.635827:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856997760 00000100:00100000:1.0:1787032064.635835:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856997760 00000100:00100000:1.0:1787032064.635884:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787032064.635893:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebfc6037 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0402f217-6678-4505-97bf-ca0cb32c7313+3:5813:x1873838856997760:12345-0@lo:104: 00010000:00010000:1.0:1787032064.635904:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.635958:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787032064.635963:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebfc6037 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0402f217-6678-4505-97bf-ca0cb32c7313+3:5813:x1873838856997760:12345-0@lo:104: Request processed in 72us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032064.635969:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787032064.635988:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032064.635993:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.636000:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a807f9d5 already unused, calling callback (00000000c701513d) 10000000:00010000:1.0:1787032064.636003:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.636027:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032064.636032:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032064.636038:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032064.636060:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.636086:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032064.636098:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.636104:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: 00000000a807f9d5/0xcd047797ef1e95d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95d7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.636120:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032064.636122:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032064.636123:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032064.636263:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f8a06ff pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1873838856997760:0@lo:104: 00010000:00010000:0.0:1787032064.636280:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032064.636762:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e51efb92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838856997888:0@lo:103: 00000100:00100000:3.0:1787032064.636803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032064.636954:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856997888 00000100:00100000:1.0:1787032064.636959:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856997888 00010000:00010000:1.0:1787032064.636976:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 13 pid: 5790 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032064.637008:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787032064.637014:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076da19b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+13:3303:x1873838856997888:12345-0@lo:103: 00010000:00010000:1.0:1787032064.637025:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032064.637029:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 13 pid: 5790 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637046:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 13 pid: 5790 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637059:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090813d5c/0xcd047797ef1e95d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e95d0 expref: 13 pid: 5790 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637107:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637115:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787032064.637128:0:5782:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001631136s 00010000:00010000:1.0:1787032064.637132:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637138:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637143:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637148:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637153:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e77e15c8 already unused, calling callback (00000000a0af42d5) 00010000:00010000:1.0:1787032064.637156:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637162:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637195:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032064.637205:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032064.637233:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076da19b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+12:3303:x1873838856997888:12345-0@lo:103: Request processed in 220us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032064.637240:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787032064.637301:0:5813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.637309:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032064.637313:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e9608 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032064.638014:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e51efb92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838856997888:0@lo:103: 00010000:00010000:2.0:1787032064.643926:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032064.666815:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006461a663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:5778:x1873838856997632:12345-0@lo:253: Request processed in 89479us (90093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032064.666831:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787032064.667421:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077c2498f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:5778:1873838856997632:0@lo:253: 10000000:01000000:0.0:1787032064.667438:0:5778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787032064.667441:0:5778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787032064.667458:0:5778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787032064.667460:0:5778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032064.667461:0:5778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032064.667462:0:5778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032064.667463:0:5778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032064.667464:0:5778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787032064.667466:0:5778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787032064.667467:0:5778:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787032064.667468:0:5778:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787032064.667470:0:5778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032064.667472:0:5778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787032064.667486:0:5778:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787032064.680738:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787032064.687266:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787032064.687561:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787032064.687938:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787032064.688892:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787032064.689925:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787032064.691544:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787032064.691823:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787032064.692024:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787032064.692388:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787032064.692942:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787032064.693870:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787032064.858790:0:5778:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787032064.920546:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787032064.920908:0:5831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1787032064.922934:0:5830:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787032064.922941:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787032064.930846:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787032064.931147:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787032064.931564:0:5778:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787032064.931572:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787032064.932992:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787032064.935161:0:5778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787032064.935730:0:5778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787032064.935764:0:5778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787032064.936060:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787032064.936350:0:5778:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787032064.937757:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787032064.937910:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787032064.938123:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787032064.949458:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787032064.949637:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787032064.949779:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787032064.949909:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787032064.950031:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787032064.950209:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787032064.950327:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787032064.950452:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787032064.950568:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787032064.950692:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787032064.950803:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787032064.950941:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787032064.951053:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787032064.951381:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787032064.951511:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787032064.951643:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787032064.951766:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787032064.951898:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787032064.952022:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787032064.954956:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787032064.955279:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787032064.955449:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787032064.955614:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787032064.956111:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787032064.956265:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787032064.956430:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787032064.956582:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787032064.956771:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787032064.956941:0:5778:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787032064.957195:0:5778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787032065.022988:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787032065.063968:0:5778:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787032065.064005:0:5778:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6d1c1c53988 00100000:10000000:3.0:1787032065.064014:0:5778:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787032065.064666:0:5778:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787032065.064682:0:5778:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787032065.064698:0:5778:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787032065.064724:0:5778:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787032065.147461:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787032065.147571:0:5831:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1787032065.147589:0:5831:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787032065.665888:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032066.689551:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032067.713564:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032068.741612:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787032069.748361:0:6074:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787032069.761238:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787032069.891176:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787032069.891186:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787032069.891189:0:37:0:(import.c:65:import_set_state_nolock()) 000000004b7963b7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787032069.891202:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004b7963b7 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:0.0:1787032069.891221:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007f8a06ff x1873838856998144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787032069.891253:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f8a06ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838856998144:0@lo:38: 00000100:00100000:0.0:1787032069.891330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032069.891418:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856998144 00000100:00100000:0.0:1787032069.891426:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856998144 00000100:00100000:0.0:1787032069.891458:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032069.891465:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdf7e8f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1873838856998144:12345-0@lo:38: 00010000:00080000:0.0:1787032069.891488:0:5799:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1787032069.891520:0:5799:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd047797ef1e960f 00000004:00100000:0.0:1787032069.891629:0:5799:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787032069.891749:0:5799:0:(import.c:65:import_set_state_nolock()) 000000002c509f41 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032069.891805:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdf7e8f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873838856998144:12345-0@lo:38: Request processed in 339us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032069.891812:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787032069.891863:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007f8a06ff x1873838856998144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787032079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787032069.891878:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787032069.891885:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787032069.891889:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787032069.891891:0:3301:0:(import.c:65:import_set_state_nolock()) 000000004b7963b7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787032069.891896:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f8a06ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838856998144:0@lo:38: 00000100:00100000:3.0:1787032069.892186:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077c2498f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838856998016:0@lo:400: 00000100:00100000:3.0:1787032069.892226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032069.892769:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856998016 00000100:00100000:0.0:1787032069.892776:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856998016 00000100:00100000:0.0:1787032069.892819:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787032069.892827:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cd88653 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:3304:x1873838856998016:12345-0@lo:400: 00000100:00100000:0.0:1787032069.892888:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cd88653 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:3304:x1873838856998016:12345-0@lo:400: Request processed in 62us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032069.892894:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787032069.893027:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077c2498f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838856998016:0@lo:400: 00010000:00010000:2.0:1787032070.787641:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032071.811591:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032072.838197:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787032072.961814:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787032072.961822:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cde4b73800 from 3 10000000:01000000:3.0:1787032072.961826:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787032072.961882:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 0000000064968799/0xcd047797ef1e9616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032072.961894:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 0000000064968799/0xcd047797ef1e9616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032072.961904:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 0000000064968799/0xcd047797ef1e9616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032072.961926:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005a1f3f3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838856998272:0@lo:101: 00000100:00100000:3.0:1787032072.961987:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032072.962051:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c22bdf71 going to sleep for 11 seconds 00000100:00100000:0.0:1787032072.962087:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856998272 00000100:00100000:0.0:1787032072.962095:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856998272 00000100:00100000:0.0:1787032072.962154:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787032072.962161:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4979104 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:5794:x1873838856998272:12345-0@lo:101: 00010000:00010000:0.0:1787032072.962175:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032072.962188:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e961d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9616 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032072.962209:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e961d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032072.962233:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e77e15c8/0xcd047797ef1e961d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032072.962241:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e77e15c8, rc 0) 00000100:00100000:0.0:1787032072.962284:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4979104 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838856998272:12345-0@lo:101: Request processed in 123us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032072.962290:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787032072.962333:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005a1f3f3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838856998272:0@lo:101: 00010000:00010000:0.0:1787032072.962346:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 0000000064968799/0xcd047797ef1e9616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032072.962353:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 0000000064968799/0xcd047797ef1e9616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032072.962397:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f8a06ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838856998400:0@lo:256: 00000100:00100000:0.0:1787032072.962428:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032072.962450:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fff5fc07 going to sleep for 11 seconds 00000100:00100000:0.0:1787032072.962464:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856998400 00000100:00100000:0.0:1787032072.962467:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856998400 00000100:00100000:0.0:1787032072.962488:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787032072.962493:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b35be472 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838856998400:12345-0@lo:256: 20000000:01000000:0.0:1787032072.962506:0:5790:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787032072.962522:0:5790:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787032072.962525:0:5790:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787032072.962596:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b35be472 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838856998400:12345-0@lo:256: Request processed in 103us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032072.962603:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787032072.962636:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f8a06ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838856998400:0@lo:256: 10000000:01000000:0.0:1787032072.962674:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787032072.962680:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 0000000064968799/0xcd047797ef1e9616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032072.962686:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 0000000064968799/0xcd047797ef1e9616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032073.858269:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787032074.162499:0:6275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca836f7f0 20000000:00000080:2.0:1787032074.162515:0:6275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cdef9ad000 uarg=0000000000000000 20000000:01000000:2.0:1787032074.162546:0:6275:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787032074.162553:0:6275:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787032074.162558:0:6275:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787032074.162752:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787032074.162763:0:6275:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787032074.169796:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787032074.170587:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787032074.170647:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787032074.170697:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787032074.170715:0:6275:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787032074.170732:0:6275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032074.170750:0:6275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e95de expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032074.170757:0:6275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032074.170805:0:6275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e95de expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032074.170819:0:6275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e95de expref: 11 pid: 5792 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032074.170834:0:6275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000173431f1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1873838856998528:0@lo:104: 00000100:00100000:3.0:1787032074.171183:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032074.171262:0:6275:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ea3ba56 going to sleep for 11 seconds 00000100:00100000:1.0:1787032074.171574:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856998528 00000100:00100000:1.0:1787032074.171583:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856998528 00000100:00100000:1.0:1787032074.171630:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787032074.171636:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dd2417c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:6275:x1873838856998528:12345-0@lo:104: 00010000:00010000:1.0:1787032074.171648:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032074.171750:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787032074.171755:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dd2417c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:6275:x1873838856998528:12345-0@lo:104: Request processed in 120us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032074.171762:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787032074.171781:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032074.171785:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032074.171792:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000892326f1 already unused, calling callback (00000000c701513d) 10000000:00010000:1.0:1787032074.171795:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032074.171801:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032074.171807:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032074.171823:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787032074.171849:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032074.171855:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787032074.171972:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cff4bab0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838856998656:0@lo:103: 00000100:00100000:3.0:1787032074.172007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032074.172090:0:6275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000173431f1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1873838856998528:0@lo:104: 00010000:00010000:0.0:1787032074.172107:0:6275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032074.172224:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032074.172233:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: 00000000892326f1/0xcd047797ef1e95de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95e5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032074.172249:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032074.172250:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032074.172252:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032074.173540:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856998656 00000100:00100000:2.0:1787032074.173547:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856998656 00010000:00010000:2.0:1787032074.173571:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e95de expref: 12 pid: 5792 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032074.173601:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787032074.173607:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007901c79d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+12:3305:x1873838856998656:12345-0@lo:103: 00010000:00010000:2.0:1787032074.173617:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032074.173620:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e95de expref: 12 pid: 5792 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173630:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e95de expref: 12 pid: 5792 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173642:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ad395f9/0xcd047797ef1e95e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e95de expref: 12 pid: 5792 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173665:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173672:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173683:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173689:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173695:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173701:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173706:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000683f6c4c already unused, calling callback (00000000a0af42d5) 00010000:00010000:2.0:1787032074.173709:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173715:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173727:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032074.173734:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032074.174008:0:6275:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032074.174025:0:6275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032074.174029:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000683f6c4c/0xcd047797ef1e9624 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032074.177956:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007901c79d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+11:3305:x1873838856998656:12345-0@lo:103: Request processed in 4343us (5942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032074.177990:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032074.182180:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cff4bab0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838856998656:0@lo:103: 00010000:00010000:0.0:1787032074.881241:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032075.010759:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f8a06ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838856998784:0@lo:400: 00000100:00100000:1.0:1787032075.010831:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032075.011474:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856998784 00000100:00100000:0.0:1787032075.011483:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856998784 00000100:00100000:0.0:1787032075.011540:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032075.011548:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031261a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838856998784:12345-0@lo:400: 00000100:00100000:0.0:1787032075.018896:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031261a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838856998784:12345-0@lo:400: Request processed in 7340us (8056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032075.018913:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787032075.019511:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007f8a06ff x1873838856998784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032075.019527:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f8a06ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838856998784:0@lo:400: 00010000:00010000:1.0:1787032075.906973:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032076.939804:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032077.954522:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787032078.843456:0:6582:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787032078.843460:0:6582:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787032078.843697:0:6582:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f4d2780f 00000020:01000004:2.0:1787032078.843714:0:6582:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787032078.843726:0:6582:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787032078.843747:0:6582:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000b37d2f03) 00000020:00000080:2.0:1787032078.843764:0:6582:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787032078.859218:0:6582:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787032078.859659:0:6582:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787032078.882728:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787032078.889901:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787032078.889947:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787032078.890004:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787032078.890030:0:6582:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787032078.890792:0:6582:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787032078.890803:0:6582:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787032078.890813:0:6582:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd047797ef1e9632 00000020:01000004:3.0:1787032078.890821:0:6582:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787032078.890841:0:6582:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787032078.890844:0:6582:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787032078.890849:0:6582:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787032078.890854:0:6582:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787032078.890870:0:6582:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000f1a68070) 00000020:00000080:3.0:1787032078.890885:0:6582:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787032078.893842:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032078.894005:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787032078.894011:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787032078.895802:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787032078.895819:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787032078.896640:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787032078.896649:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787032078.898098:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032078.898297:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787032078.898303:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787032078.902866:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787032078.902880:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787032078.924332:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032078.924725:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787032078.924731:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787032078.927478:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787032078.927494:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787032078.928448:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787032078.928467:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787032078.932150:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032078.932330:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787032078.932335:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787032078.933332:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787032078.933340:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787032078.978863:0:6582:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032078.979045:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787032078.979052:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00010000:00010000:0.0:1787032078.979487:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032078.980500:0:6582:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787032078.980509:0:6582:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787032078.980970:0:6582:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787032078.980993:0:6582:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787032078.980999:0:6582:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787032079.005761:0:6582:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787032079.005807:0:6582:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.148@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787032079.005812:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787032079.005814:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787032079.005815:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787032079.005816:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787032079.005817:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787032079.005818:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787032079.005819:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787032079.005820:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787032079.005822:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787032079.005823:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787032079.005825:0:6582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787032079.005828:0:6582:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787032079.005830:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787032079.005831:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787032079.005832:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787032079.005833:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787032079.005839:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787032079.005840:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787032079.005841:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787032079.005842:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787032079.005842:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787032079.005843:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787032079.005844:0:6582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787032079.005873:0:6582:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787032079.005891:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e14d6e8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838856998912:0@lo:253: 00000100:00100000:2.0:1787032079.006230:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032079.006331:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f2f291d3 going to sleep for 11 seconds 00000100:00100000:0.0:1787032079.006494:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856998912 00000100:00100000:0.0:1787032079.006502:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856998912 00000100:00100000:0.0:1787032079.006700:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787032079.006708:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007449314d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838856998912:12345-0@lo:253: 20000000:01000000:0.0:1787032079.006738:0:5790:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787032079.006743:0:5790:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787032079.006747:0:5790:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787032079.006750:0:5790:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787032079.007917:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787032079.008460:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787032079.008475:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787032079.008516:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787032079.008524:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787032079.008556:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787032079.008696:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787032079.009217:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787032079.009237:0:5790:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.148@tcp 20000000:01000000:0.0:1787032079.009238:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.148@tcp (null) (null) (null) 00000040:00080000:0.0:1787032079.009270:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787032079.009277:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787032079.009316:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787032079.009323:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.148@tcp (null) (null) 00000040:00080000:0.0:1787032079.009349:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787032079.009356:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787032079.009684:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787032079.009741:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787032079.011293:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787032079.011321:0:5790:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.148@tcp 20000000:01000000:0.0:1787032079.011323:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.148@tcp (null) (null) (null) 00000040:00080000:0.0:1787032079.011435:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787032079.011444:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787032079.011475:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787032079.011482:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.148@tcp (null) (null) 00000040:00080000:0.0:1787032079.011668:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787032079.011678:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787032079.011708:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787032079.011740:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787032079.011755:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787032079.011757:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787032079.011761:0:5790:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787032079.011772:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787032079.011775:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787032079.011806:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787032079.011808:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787032079.012720:0:6597:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787032079.012777:0:6597:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787032079.012851:0:6597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787032079.013489:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787032079.013664:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787032079.013726:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787032079.013740:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787032079.013742:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787032079.014352:0:6598:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787032079.014419:0:6598:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787032079.014471:0:6598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787032079.015059:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787032079.015276:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787032079.015319:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787032079.015330:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787032079.015332:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787032079.015854:0:6599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787032079.016205:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787032079.016239:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787032079.016288:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787032079.016303:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787032079.016304:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787032079.016313:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787032079.016328:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.016345:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.016352:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e957c expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.016358:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.016427:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.016463:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.016476:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 11 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.016490:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019978eab pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838856999040:0@lo:104: 00000100:00100000:1.0:1787032079.016674:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787032079.016774:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e957c expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.016782:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e957c expref: 11 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.016790:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c62b1ae0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838856999168:0@lo:104: 00000100:00100000:1.0:1787032079.016809:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787032079.016876:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.016884:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 11 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.016891:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000048e41da4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838856999296:0@lo:104: 00000100:00100000:1.0:1787032079.016908:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.017011:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856999040 00000100:00100000:0.0:1787032079.017019:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856999040 00000100:00100000:0.0:1787032079.017050:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856999168 00000100:00100000:0.0:1787032079.017052:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856999168 00000100:00100000:0.0:1787032079.017062:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787032079.017085:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ba07529 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:5790:x1873838856999040:12345-0@lo:104: 00010000:00010000:0.0:1787032079.017097:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017147:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787032079.017152:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ba07529 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:5790:x1873838856999040:12345-0@lo:104: Request processed in 68us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.017159:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787032079.017172:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787032079.017177:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085064bf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:5790:x1873838856999168:12345-0@lo:104: 00010000:00010000:0.0:1787032079.017189:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017217:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787032079.017220:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085064bf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:5790:x1873838856999168:12345-0@lo:104: Request processed in 44us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.017225:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787032079.017239:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787032079.017244:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017252:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b6149f41 already unused, calling callback (00000000c701513d) 10000000:00010000:0.0:1787032079.017254:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017262:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032079.017268:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032079.017274:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032079.017296:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017301:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032079.017316:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017322:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: 00000000b6149f41/0xcd047797ef1e95ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e95f3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017339:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032079.017341:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017346:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be41f333 already unused, calling callback (00000000c701513d) 10000000:00010000:0.0:1787032079.017348:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017353:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032079.017358:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032079.017373:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032079.017383:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017389:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032079.017400:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017405:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: 00000000be41f333/0xcd047797ef1e957c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9583 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017415:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032079.017416:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032079.017417:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032079.017433:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838856999424:0@lo:103: 00000100:00100000:0.0:1787032079.017461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.017490:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067c70ea1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838856999552:0@lo:103: 00000100:00100000:0.0:1787032079.017508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.017550:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856999424 00000100:00100000:0.0:1787032079.017553:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856999424 00010000:00010000:0.0:1787032079.017566:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 12 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.017751:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f3c61bdb going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.017767:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019978eab pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838856999040:0@lo:104: 00000100:00100000:1.0:1787032079.017775:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c62b1ae0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838856999168:0@lo:104: 00000100:00100000:0.0:1787032079.017847:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856999552 00000100:00100000:0.0:1787032079.017850:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856999552 00010000:00010000:0.0:1787032079.017860:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e957c expref: 13 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032079.017870:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787032079.017874:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1978d31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+13:3303:x1873838856999424:12345-0@lo:103: 00010000:00010000:0.0:1787032079.017882:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032079.017886:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 13 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017894:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 13 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017905:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1dfdcdb/0xcd047797ef1e95f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e95ec expref: 13 pid: 5791 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017916:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032079.017953:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1978d31 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+12:3303:x1873838856999424:12345-0@lo:103: Request processed in 78us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.017959:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787032079.017969:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787032079.017979:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d711084c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+11:3304:x1873838856999552:12345-0@lo:103: 00010000:00010000:0.0:1787032079.017985:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032079.017988:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e957c expref: 11 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.017995:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e957c expref: 11 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018004:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000af5a10dd/0xcd047797ef1e9583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e957c expref: 11 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018012:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032079.018031:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d711084c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+10:3304:x1873838856999552:12345-0@lo:103: Request processed in 54us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.018036:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787032079.018058:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067c70ea1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838856999552:0@lo:103: 00000100:00100000:0.0:1787032079.018105:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838856999424:0@lo:103: 00000100:00100000:0.0:1787032079.018116:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856999296 00000100:00100000:0.0:1787032079.018118:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856999296 00000100:00100000:0.0:1787032079.018131:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032079.018134:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b6b8c74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:5790:x1873838856999296:12345-0@lo:104: 00010000:00010000:0.0:1787032079.018141:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018170:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787032079.018173:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b6b8c74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:5790:x1873838856999296:12345-0@lo:104: Request processed in 39us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.018178:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787032079.018195:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032079.018197:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018203:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d365ae09 already unused, calling callback (00000000c701513d) 10000000:00010000:0.0:1787032079.018205:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018211:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032079.018216:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032079.018221:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032079.018236:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018241:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032079.018248:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018253:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e9560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9567 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018264:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032079.018265:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032079.018266:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032079.018272:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838856999680:0@lo:103: 00000100:00100000:0.0:1787032079.018293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.018318:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856999680 00000100:00100000:0.0:1787032079.018325:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856999680 00010000:00010000:0.0:1787032079.018335:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 10 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032079.018350:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032079.018354:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067c70ea1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+10:3305:x1873838856999680:12345-0@lo:103: 00010000:00010000:0.0:1787032079.018373:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032079.018376:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 10 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018383:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 10 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018394:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018400:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018412:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018417:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018423:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018428:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018433:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f46f914 already unused, calling callback (00000000a0af42d5) 00010000:00010000:0.0:1787032079.018440:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018446:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018453:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018461:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032079.018481:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067c70ea1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+10:3305:x1873838856999680:12345-0@lo:103: Request processed in 128us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.018487:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032079.018520:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838856999680:0@lo:103: 00010000:00010000:0.0:1787032079.018551:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9560 expref: 9 pid: 5790 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032079.018559:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000048e41da4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838856999296:0@lo:104: 00010000:00010000:0.0:1787032079.018776:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018785:0:5790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018790:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.018796:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009f46f914/0xcd047797ef1e9640 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787032079.018810:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1787032079.018895:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032079.060259:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007449314d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+8:6582:x1873838856998912:12345-0@lo:253: Request processed in 53544us (54187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.060275:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787032079.060390:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e14d6e8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838856998912:0@lo:253: 10000000:01000000:2.0:1787032079.060405:0:6582:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787032079.060408:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787032079.060410:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787032079.060412:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787032079.060413:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787032079.060414:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787032079.060415:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787032079.060416:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787032079.060418:0:6582:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787032079.060419:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787032079.060421:0:6582:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787032079.060440:0:6582:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f4d2780f from lustre-OST0000 10000000:01000000:2.0:1787032079.060463:0:6582:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787032079.060465:0:6582:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787032079.060471:0:6582:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cdc7654d40 local copy 10000000:01000000:2.0:1787032079.060475:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787032079.060507:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.060528:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.060553:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032079.060694:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e14d6e8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838856999808:0@lo:101: 00000100:00100000:2.0:1787032079.060730:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032079.060780:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ccf04ee0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032079.060842:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856999808 00000100:00100000:0.0:1787032079.060848:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856999808 00000100:00100000:0.0:1787032079.060887:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787032079.060895:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ac1410f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+8:6582:x1873838856999808:12345-0@lo:101: 00010000:00010000:0.0:1787032079.060906:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032079.060918:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d365ae09/0xcd047797ef1e964e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9647 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.060949:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d365ae09/0xcd047797ef1e964e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9647 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.060958:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d365ae09/0xcd047797ef1e964e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9647 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.060967:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d365ae09, rc 0) 00000100:00100000:0.0:1787032079.060995:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ac1410f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+9:6582:x1873838856999808:12345-0@lo:101: Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.061000:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787032079.061117:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e14d6e8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838856999808:0@lo:101: 00010000:00010000:1.0:1787032079.061131:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.061139:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.061227:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838856999936:0@lo:501: 00000100:00100000:1.0:1787032079.061252:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.061274:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 0000000001d674ee going to sleep for 11 seconds 00000100:00100000:0.0:1787032079.061327:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838856999936 00000100:00100000:0.0:1787032079.061331:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838856999936 00000100:00100000:0.0:1787032079.061368:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787032079.061374:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df04a107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:6582:x1873838856999936:12345-0@lo:501: 00000100:00100000:0.0:1787032079.061545:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df04a107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:6582:x1873838856999936:12345-0@lo:501: Request processed in 171us (293us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032079.061552:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787032079.061808:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838856999936:0@lo:501: 10000000:01000000:1.0:1787032079.061820:0:6582:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787032079.061843:0:6582:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787032079.061847:0:6582:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.061854:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.061860:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.061881:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787032079.061895:0:6582:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cdefa84800 10000000:01000000:1.0:1787032079.061899:0:6582:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787032079.061903:0:6582:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99cdc7654d40 10000000:01000000:1.0:1787032079.061905:0:6582:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787032079.061908:0:6582:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99cdc7654d40 from 1 10000000:01000000:1.0:1787032079.061911:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787032079.061938:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000088a5e77/0xcd047797ef1e9655 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.061945:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000088a5e77/0xcd047797ef1e9655 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.061952:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000088a5e77/0xcd047797ef1e9655 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.061963:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000064:0@lo:101: 00000100:00100000:1.0:1787032079.061997:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.062011:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050b8a9b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.062023:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857000064 00000100:00100000:1.0:1787032079.062026:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857000064 00000100:00100000:1.0:1787032079.062046:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787032079.062050:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a91957e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+9:6582:x1873838857000064:12345-0@lo:101: 00010000:00010000:1.0:1787032079.062057:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032079.062064:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c808fcd/0xcd047797ef1e965c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9655 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062099:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c808fcd/0xcd047797ef1e965c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9655 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062107:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c808fcd/0xcd047797ef1e965c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9655 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062114:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c808fcd, rc 0) 00000100:00100000:1.0:1787032079.062140:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a91957e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+10:6582:x1873838857000064:12345-0@lo:101: Request processed in 89us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.062145:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787032079.062175:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000064:0@lo:101: 00010000:00010000:1.0:1787032079.062183:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000088a5e77/0xcd047797ef1e9655 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e965c expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062190:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000088a5e77/0xcd047797ef1e9655 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e965c expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032079.062202:0:6582:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787032079.062210:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 00000000088a5e77/0xcd047797ef1e9655 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e965c expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062222:0:6582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 00000000088a5e77/0xcd047797ef1e9655 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e965c expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032079.062229:0:6582:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787032079.062231:0:6582:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787032079.062235:0:6582:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787032079.062237:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787032079.062250:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000abd449fb/0xcd047797ef1e9663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062255:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000abd449fb/0xcd047797ef1e9663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062262:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000abd449fb/0xcd047797ef1e9663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.062272:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000192:0@lo:101: 00000100:00100000:1.0:1787032079.062297:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.062314:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050b8a9b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.062330:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857000192 00000100:00100000:1.0:1787032079.062334:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857000192 00000100:00100000:1.0:1787032079.062353:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787032079.062428:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6993e27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+10:6582:x1873838857000192:12345-0@lo:101: 00010000:00010000:1.0:1787032079.062437:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032079.062445:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009f46f914/0xcd047797ef1e966a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9663 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062457:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009f46f914/0xcd047797ef1e966a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062469:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009f46f914/0xcd047797ef1e966a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062476:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009f46f914, rc 0) 00000100:00100000:1.0:1787032079.062502:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6993e27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857000192:12345-0@lo:101: Request processed in 144us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.062632:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787032079.062666:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000192:0@lo:101: 00010000:00010000:1.0:1787032079.062676:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000abd449fb/0xcd047797ef1e9663 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.062683:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000abd449fb/0xcd047797ef1e9663 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.062736:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000320:0@lo:501: 00000100:00100000:1.0:1787032079.062760:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.062773:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050b8a9b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.062786:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857000320 00000100:00100000:1.0:1787032079.062789:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857000320 00000100:00100000:1.0:1787032079.062809:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787032079.062814:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007489082b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857000320:12345-0@lo:501: 00000100:00100000:1.0:1787032079.062999:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007489082b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857000320:12345-0@lo:501: Request processed in 185us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.063006:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787032079.063036:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000320:0@lo:501: 00000100:00100000:1.0:1787032079.063062:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000448:0@lo:503: 00000100:00100000:1.0:1787032079.063129:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.063146:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050b8a9b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.063158:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857000448 00000100:00100000:1.0:1787032079.063161:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857000448 00000100:00100000:1.0:1787032079.063179:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787032079.063184:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087b7815e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857000448:12345-0@lo:503: 00000100:00100000:1.0:1787032079.063310:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087b7815e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857000448:12345-0@lo:503: Request processed in 126us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.063317:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787032079.063348:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000448:0@lo:503: 00010000:00010000:0.0:1787032079.063524:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032079.063537:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.063545:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000664bed0 already unused, calling callback (00000000c701513d) 10000000:00010000:0.0:1787032079.063548:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.063555:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032079.063561:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032079.063567:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032079.063597:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.063603:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032079.063632:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.063639:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: 000000000664bed0/0xcd047797ef1e9647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd047797ef1e964e expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.063650:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032079.063651:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032079.063652:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032079.063659:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787032079.063669:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857000576:0@lo:103: 00000100:00100000:0.0:1787032079.063699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.063725:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857000576 00000100:00100000:0.0:1787032079.063734:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857000576 00000100:00100000:0.0:1787032079.063764:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032079.063770:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6183946 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+11:3303:x1873838857000576:12345-0@lo:103: 00010000:00010000:0.0:1787032079.063778:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032079.063789:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d365ae09/0xcd047797ef1e964e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9647 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.063799:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032079.063824:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6183946 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+10:3303:x1873838857000576:12345-0@lo:103: Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.063831:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032079.063858:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857000576:0@lo:103: 00000040:00080000:1.0:1787032079.064498:0:6582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787032079.064682:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000704:0@lo:502: 00000100:00100000:1.0:1787032079.064725:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.064747:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050b8a9b0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032079.064845:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857000704 00000100:00100000:0.0:1787032079.064849:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857000704 00000100:00100000:0.0:1787032079.064937:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787032079.064944:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8d3381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+10:6582:x1873838857000704:12345-0@lo:502: 00000100:00100000:0.0:1787032079.065116:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8d3381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+10:6582:x1873838857000704:12345-0@lo:502: Request processed in 173us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.065123:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787032079.065268:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000704:0@lo:502: 00000040:00080000:1.0:1787032079.065504:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787032079.065561:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787032079.065720:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787032079.065780:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787032079.065817:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787032079.065846:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787032079.065870:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000832:0@lo:502: 00000100:00100000:1.0:1787032079.065906:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.066149:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050b8a9b0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032079.066246:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857000832 00000100:00100000:2.0:1787032079.066251:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857000832 00000100:00100000:2.0:1787032079.066276:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787032079.066281:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043189846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+10:6582:x1873838857000832:12345-0@lo:502: 00000100:00100000:2.0:1787032079.066443:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043189846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+10:6582:x1873838857000832:12345-0@lo:502: Request processed in 161us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.066450:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787032079.066700:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d1cde63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000832:0@lo:502: 00000040:00080000:1.0:1787032079.066801:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787032079.066812:0:6582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787032079.067325:0:6600:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787032079.067333:0:6600:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787032079.067339:0:6600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032079.067341:0:6600:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787032079.067345:0:6600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787032079.067435:0:6600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000028038241) 00000020:00000080:1.0:1787032079.067459:0:6600:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787032079.067467:0:6600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787032079.067692:0:6600:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f4d2780f from lustre-OST0000, refs=2 00080000:01000000:1.0:1787032079.067700:0:6600:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787032079.067706:0:6600:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd047797ef1e9678 00010000:00010000:1.0:1787032079.075659:0:6600:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787032079.075986:0:6600:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787032079.078992:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787032079.079387:0:6600:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787032079.091610:0:6600:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787032079.094453:0:6600:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787032079.105686:0:6600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787032079.105698:0:6600:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032079.105704:0:6600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032079.105707:0:6600:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787032079.105711:0:6600:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032079.105715:0:6600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032079.105717:0:6600:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787032079.105720:0:6600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787032079.105734:0:6600:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787032079.105788:0:6600:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032079.105791:0:6600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032079.105792:0:6600:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787032079.105795:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787032079.110490:0:6582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787032079.110605:0:6582:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787032079.110624:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: 00000000abd449fb/0xcd047797ef1e9663 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.110638:0:6582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: 00000000abd449fb/0xcd047797ef1e9663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032079.110772:0:6582:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdefa84800 from 1 10000000:01000000:0.0:1787032079.110776:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787032079.110814:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e967f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.110822:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e967f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.110832:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e967f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032079.110854:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000960:0@lo:101: 00000100:00100000:0.0:1787032079.110919:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.110974:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 000000006a1a5054 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.111037:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857000960 00000100:00100000:1.0:1787032079.111045:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857000960 00000100:00100000:1.0:1787032079.111108:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787032079.111117:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f448d452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+10:6582:x1873838857000960:12345-0@lo:101: 00010000:00010000:1.0:1787032079.111128:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032079.111142:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9686 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e967f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.111176:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e967f expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.111185:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e3f4db0/0xcd047797ef1e9686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e967f expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.111193:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e3f4db0, rc 0) 00000100:00100000:1.0:1787032079.111229:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f448d452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857000960:12345-0@lo:101: Request processed in 115us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.111236:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787032079.113542:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857000960:0@lo:101: 00010000:00010000:0.0:1787032079.113566:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e967f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.113578:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: 00000000d365ae09/0xcd047797ef1e967f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032079.113690:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001088:0@lo:501: 00000100:00100000:0.0:1787032079.113739:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.113777:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 000000006a1a5054 going to sleep for 11 seconds 00000100:00100000:2.0:1787032079.113914:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857001088 00000100:00100000:2.0:1787032079.113929:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857001088 00000100:00100000:2.0:1787032079.113963:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787032079.113969:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cc974fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001088:12345-0@lo:501: 00000100:00100000:2.0:1787032079.114199:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cc974fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001088:12345-0@lo:501: Request processed in 229us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.114206:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787032079.114355:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001088:0@lo:501: 00000100:00100000:0.0:1787032079.114471:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001216:0@lo:503: 00000100:00100000:0.0:1787032079.114504:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.116845:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 000000006a1a5054 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.117396:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857001216 00000100:00100000:1.0:1787032079.117409:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857001216 00000100:00100000:1.0:1787032079.117466:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787032079.117476:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000143a9b18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001216:12345-0@lo:503: 00000100:00100000:1.0:1787032079.120001:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000143a9b18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001216:12345-0@lo:503: Request processed in 2519us (5488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.120019:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787032079.122290:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001216:0@lo:503: 00000040:00080000:0.0:1787032079.122820:0:6582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787032079.122904:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001344:0@lo:502: 00000100:00100000:0.0:1787032079.122996:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.123126:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 000000006a1a5054 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.123298:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857001344 00000100:00100000:1.0:1787032079.123305:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857001344 00000100:00100000:2.0:1787032079.123492:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787032079.123502:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d64a7c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001344:12345-0@lo:502: 00000100:00100000:2.0:1787032079.123758:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d64a7c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001344:12345-0@lo:502: Request processed in 257us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.123765:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787032079.123842:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001344:0@lo:502: 00000040:00080000:0.0:1787032079.124132:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787032079.124178:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787032079.124203:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001472:0@lo:502: 00000100:00100000:0.0:1787032079.124236:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.124968:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set 000000006a1a5054 going to sleep for 11 seconds 00000100:00100000:3.0:1787032079.125004:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857001472 00000100:00100000:3.0:1787032079.125010:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857001472 00000100:00100000:2.0:1787032079.125057:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787032079.125096:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044e5837d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001472:12345-0@lo:502: 00000100:00100000:2.0:1787032079.125258:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044e5837d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001472:12345-0@lo:502: Request processed in 164us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.125266:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787032079.125352:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9928a3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001472:0@lo:502: 00000040:00080000:0.0:1787032079.125473:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787032079.125485:0:6582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787032079.126417:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787032079.126428:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032079.126430:0:6604:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787032079.126437:0:6604:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdefa84800 00000020:00000080:1.0:1787032079.126440:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787032079.126471:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032079.126474:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032079.126475:0:6604:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787032079.126477:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787032079.126824:0:6582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787032079.126847:0:6582:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787032079.126896:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.126909:0:6582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032079.126959:0:6582:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787032079.126962:0:6582:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cdefa84800 10000000:01000000:2.0:1787032079.126966:0:6582:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cdefa84800 10000000:01000000:2.0:1787032079.126970:0:6582:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787032079.126975:0:6582:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cdefa84800 from 1 10000000:01000000:2.0:1787032079.126978:0:6582:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787032079.127011:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.127020:0:6582:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.127030:0:6582:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032079.127050:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001600:0@lo:101: 00000100:00100000:2.0:1787032079.127137:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032079.127182:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787032079.127623:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857001600 00000100:00100000:2.0:1787032079.127630:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857001600 00000100:00100000:2.0:1787032079.127674:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787032079.127682:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857001600:12345-0@lo:101: 00010000:00010000:2.0:1787032079.127693:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032079.127705:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e968d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.127726:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e968d expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.127736:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e968d expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.127745:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6000, rc 0) 00000100:00100000:2.0:1787032079.127786:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857001600:12345-0@lo:101: Request processed in 103us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.127791:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787032079.127833:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001600:0@lo:101: 00010000:00010000:2.0:1787032079.127847:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.127854:0:6582:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032079.127943:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001728:0@lo:501: 00000100:00100000:2.0:1787032079.127969:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032079.127991:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857001728 00000100:00100000:2.0:1787032079.128003:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857001728 00000100:00100000:2.0:1787032079.128025:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787032079.128031:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857001728:12345-0@lo:501: 00000100:00100000:2.0:1787032079.128253:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857001728:12345-0@lo:501: Request processed in 222us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.128260:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787032079.128291:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787032079.128303:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001728:0@lo:501: 00000100:00100000:2.0:1787032079.128324:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001856:0@lo:503: 00000100:00100000:2.0:1787032079.128356:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032079.128388:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857001856 00000100:00100000:2.0:1787032079.128392:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857001856 00000100:00100000:2.0:1787032079.128409:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787032079.128413:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857001856:12345-0@lo:503: 00000100:00100000:2.0:1787032079.128532:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857001856:12345-0@lo:503: Request processed in 116us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.128551:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787032079.128580:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787032079.128593:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001856:0@lo:503: 00000040:00080000:2.0:1787032079.128826:0:6582:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787032079.128873:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001984:0@lo:502: 00000100:00100000:2.0:1787032079.128904:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032079.128936:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857001984 00000100:00100000:2.0:1787032079.128940:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857001984 00000100:00100000:2.0:1787032079.128963:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787032079.128969:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857001984:12345-0@lo:502: 00000100:00100000:2.0:1787032079.129130:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857001984:12345-0@lo:502: Request processed in 160us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.129137:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787032079.129168:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787032079.129181:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857001984:0@lo:502: 00000040:00080000:2.0:1787032079.129389:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787032079.129429:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787032079.129459:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787032079.129503:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787032079.129541:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787032079.129602:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787032079.129640:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787032079.129675:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787032079.129720:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787032079.129756:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787032079.129790:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787032079.129834:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787032079.129869:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787032079.129900:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787032079.129974:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787032079.130013:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787032079.130047:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787032079.130122:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787032079.130161:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787032079.130195:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787032079.130243:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787032079.130295:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787032079.130332:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787032079.130394:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787032079.130436:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787032079.130471:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787032079.130530:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787032079.130566:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787032079.130597:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857002112:0@lo:502: 00000100:00100000:2.0:1787032079.130652:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032079.130690:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857002112 00000100:00100000:2.0:1787032079.130695:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857002112 00000100:00100000:2.0:1787032079.130725:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787032079.130732:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857002112:12345-0@lo:502: 00000100:00100000:2.0:1787032079.130889:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857002112:12345-0@lo:502: Request processed in 157us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.130896:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787032079.132376:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787032079.132407:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857002112:0@lo:502: 00000040:00080000:2.0:1787032079.132520:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787032079.132535:0:6582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787032079.133395:0:6605:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787032079.133410:0:6605:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99cdc76f8000) 00000020:00000080:2.0:1787032079.133429:0:6605:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787032079.133612:0:6605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdefa84800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787032079.133616:0:6605:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cdefa84800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787032079.133619:0:6605:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdefa84800 3 00010000:00080000:2.0:1787032079.133646:0:6605:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cdffa3c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.148@tcp at head 00010000:00010000:2.0:1787032079.137544:0:6605:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787032079.137646:0:6605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787032079.137683:0:6605:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787032079.137696:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd047797ef1e96a2 00000100:00080000:2.0:1787032079.137706:0:6605:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787032079.137711:0:6605:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cdffa3c800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:2.0:1787032079.137758:0:6605:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdc8d5aa00 x1873838857002240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787032079.137792:0:6605:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787032079.138013:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1873838857002240:0@lo:38: 00000100:00100000:3.0:1787032079.138119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032079.138182:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857002240 00000100:00100000:3.0:1787032079.138189:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857002240 00000100:00100000:3.0:1787032079.138222:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787032079.138228:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1873838857002240:12345-0@lo:38: 00010000:00080000:3.0:1787032079.138250:0:5797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1787032079.138277:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd047797ef1e96a9 00000004:00100000:3.0:1787032079.138292:0:5797:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787032079.138320:0:5797:0:(import.c:65:import_set_state_nolock()) ffff99cdeed10800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787032079.138371:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873838857002240:12345-0@lo:38: Request processed in 140us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032079.138378:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787032079.138412:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdc8d5aa00 x1873838857002240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787032089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032079.138422:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787032079.138429:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787032079.138435:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787032079.138439:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787032079.138441:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdffa3c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787032079.138446:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1873838857002240:0@lo:38: 00000100:00100000:2.0:1787032079.141646:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032079.141670:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857002368:0@lo:400: 00000100:00100000:2.0:1787032079.141736:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787032079.141945:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787032079.141992:0:6582:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787032079.142015:0:6582:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787032079.142032:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032079.142043:0:6582:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787032079.142127:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787032079.142130:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787032079.142131:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787032079.142132:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787032079.142134:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787032079.142135:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787032079.142137:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787032079.142139:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787032079.142141:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787032079.142142:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787032079.142143:0:6582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787032079.142147:0:6582:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787032079.142150:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787032079.142151:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787032079.142152:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787032079.142154:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787032079.142155:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787032079.142156:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787032079.142162:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787032079.142163:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787032079.142164:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787032079.142165:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787032079.142166:0:6582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787032079.142183:0:6582:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787032079.142197:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857002496:0@lo:253: 00000100:00100000:2.0:1787032079.142234:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032079.142261:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857002496 00000100:00100000:2.0:1787032079.142267:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857002496 00000100:00100000:2.0:1787032079.142304:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032079.142312:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:6582:x1873838857002496:12345-0@lo:253: 20000000:01000000:2.0:1787032079.142340:0:5790:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787032079.142352:0:5790:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787032079.142545:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857002368 00000100:00100000:3.0:1787032079.142551:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857002368 00000100:00100000:3.0:1787032079.142581:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032079.142595:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857002368:12345-0@lo:400: 00000100:00100000:3.0:1787032079.142647:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857002368:12345-0@lo:400: Request processed in 51us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032079.142653:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787032079.142695:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdf4874380 x1873838857002368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032079.142709:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857002368:0@lo:400: 00000100:00100000:3.0:1787032079.143185:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613ac00 going to sleep for 11 seconds 20000000:01000000:2.0:1787032079.171806:0:5790:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787032079.171824:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787032079.171907:0:5813:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787032079.171912:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787032079.171943:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.171961:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc0031c00/0xcd047797ef1e961d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.171968:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.172027:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc0031c00/0xcd047797ef1e961d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.172041:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc0031c00/0xcd047797ef1e961d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 12 pid: 5791 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032079.172056:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1873838857002624:0@lo:104: 00000100:00100000:0.0:1787032079.172145:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.172203:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc76f3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.172370:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857002624 00000100:00100000:1.0:1787032079.172384:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857002624 00000100:00100000:1.0:1787032079.172422:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787032079.172431:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:5813:x1873838857002624:12345-0@lo:104: 00010000:00010000:1.0:1787032079.172442:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.172497:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787032079.172503:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:5813:x1873838857002624:12345-0@lo:104: Request processed in 74us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.172510:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787032079.172531:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032079.172537:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.172544:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ce02047a00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032079.172548:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.172556:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032079.172563:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032079.172568:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032079.172595:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.172601:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032079.172615:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9616 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.172627:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e961d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.172642:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032079.172644:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032079.172645:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032079.172802:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1873838857002624:0@lo:104: 00010000:00010000:0.0:1787032079.172821:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032079.172842:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857002752:0@lo:103: 00000100:00100000:0.0:1787032079.172872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.174569:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857002752 00000100:00100000:1.0:1787032079.174581:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857002752 00010000:00010000:1.0:1787032079.174613:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc0031c00/0xcd047797ef1e961d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 13 pid: 5791 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.174641:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787032079.174649:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+13:3304:x1873838857002752:12345-0@lo:103: 00010000:00010000:1.0:1787032079.174662:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032079.174667:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc0031c00/0xcd047797ef1e961d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 13 pid: 5791 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174679:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc0031c00/0xcd047797ef1e961d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 13 pid: 5791 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174695:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0031c00/0xcd047797ef1e961d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9616 expref: 13 pid: 5791 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174711:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174719:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787032079.174751:0:5782:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002839530s 00010000:00010000:1.0:1787032079.174757:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174763:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174770:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174777:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174783:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032079.174787:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174794:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174813:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.174824:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032079.174880:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+12:3304:x1873838857002752:12345-0@lo:103: Request processed in 231us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.174888:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787032079.175174:0:5813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.175193:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.175200:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0030e00/0xcd047797ef1e96b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032079.175334:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857002752:0@lo:103: 00000100:00100000:1.0:1787032079.179593:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:6582:x1873838857002496:12345-0@lo:253: Request processed in 37272us (37349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.179607:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787032079.179691:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:6582:1873838857002496:0@lo:253: 10000000:01000000:3.0:1787032079.179705:0:6582:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787032079.179709:0:6582:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787032079.179711:0:6582:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787032079.179712:0:6582:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032079.179713:0:6582:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032079.179714:0:6582:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032079.179715:0:6582:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032079.179717:0:6582:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032079.179718:0:6582:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787032079.179720:0:6582:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787032079.179721:0:6582:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032079.179723:0:6582:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787032079.179737:0:6582:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787032079.184335:0:6582:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032079.184597:0:6582:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787032079.184803:0:6582:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032079.185014:0:6582:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787032079.185290:0:6582:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032079.185965:0:6582:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787032079.187334:0:6582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:3.0:1787032079.273965:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787032079.273973:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cde4b73800 from 21 10000000:01000000:3.0:1787032079.273978:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787032079.274019:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032079.274031:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032079.274042:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032079.274094:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857002880:0@lo:101: 00000100:00100000:3.0:1787032079.274162:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032079.274211:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc395ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787032079.274231:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857002880 00000100:00100000:3.0:1787032079.274237:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857002880 00000100:00100000:3.0:1787032079.274280:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787032079.274288:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+11:5794:x1873838857002880:12345-0@lo:101: 00010000:00010000:3.0:1787032079.274301:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032079.274313:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e96b7 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032079.274337:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032079.274348:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032079.274356:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ce02047c00, rc 0) 00000100:00100000:3.0:1787032079.275113:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838857002880:12345-0@lo:101: Request processed in 824us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032079.275122:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787032079.275177:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857002880:0@lo:101: 00010000:00010000:3.0:1787032079.275192:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032079.275201:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032079.275265:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003008:0@lo:501: 00000100:00100000:3.0:1787032079.275294:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032079.275317:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc395ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787032079.275332:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857003008 00000100:00100000:3.0:1787032079.275336:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857003008 00000100:00100000:3.0:1787032079.275612:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787032079.275621:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838857003008:12345-0@lo:501: 00000100:00100000:3.0:1787032079.275824:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838857003008:12345-0@lo:501: Request processed in 203us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032079.275831:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787032079.275857:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003008:0@lo:501: 00000100:00100000:3.0:1787032079.275884:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003136:0@lo:503: 00000100:00100000:3.0:1787032079.275933:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032079.275948:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc395ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787032079.275960:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857003136 00000100:00100000:3.0:1787032079.275963:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857003136 00000100:00100000:3.0:1787032079.275985:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787032079.275991:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838857003136:12345-0@lo:503: 00000100:00100000:3.0:1787032079.276160:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838857003136:12345-0@lo:503: Request processed in 169us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032079.276167:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787032079.276203:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003136:0@lo:503: 00000100:00100000:1.0:1787032079.283218:0:6609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6609:1873838857003264:0@lo:502: 00000100:00100000:1.0:1787032079.283297:0:6609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.283334:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857003264 00000100:00100000:1.0:1787032079.283342:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857003264 00000100:00100000:1.0:1787032079.283394:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787032079.283402:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6609:x1873838857003264:12345-0@lo:502: 00000100:00100000:1.0:1787032079.283603:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:6609:x1873838857003264:12345-0@lo:502: Request processed in 201us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.283611:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787032079.283666:0:6609:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.283685:0:6609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6609:1873838857003264:0@lo:502: 00000100:00100000:1.0:1787032079.283724:0:6609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6609:1873838857003392:0@lo:502: 00000100:00100000:1.0:1787032079.283755:0:6609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.283773:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857003392 00000100:00100000:1.0:1787032079.283777:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857003392 00000100:00100000:1.0:1787032079.283794:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787032079.283800:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:6609:x1873838857003392:12345-0@lo:502: 00000100:00100000:1.0:1787032079.283910:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:6609:x1873838857003392:12345-0@lo:502: Request processed in 109us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.283930:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787032079.283955:0:6609:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.283966:0:6609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6609:1873838857003392:0@lo:502: 00000040:00080000:1.0:1787032079.283982:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787032079.284030:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787032079.284047:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787032079.284056:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284090:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032079.284100:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787032079.284102:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cde4b73800 from 4 10000000:01000000:1.0:1787032079.284105:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787032079.284131:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284140:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284150:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.284162:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003520:0@lo:101: 00000100:00100000:1.0:1787032079.284189:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.284207:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.284225:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857003520 00000100:00100000:1.0:1787032079.284229:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857003520 00000100:00100000:1.0:1787032079.284251:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787032079.284257:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838857003520:12345-0@lo:101: 00010000:00010000:1.0:1787032079.284265:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032079.284277:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e96c5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284297:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284308:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284317:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536800, rc 0) 00000100:00100000:1.0:1787032079.284348:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857003520:12345-0@lo:101: Request processed in 90us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.284354:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787032079.284383:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003520:0@lo:101: 00010000:00010000:1.0:1787032079.284394:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284403:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.284441:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003648:0@lo:256: 00000100:00100000:1.0:1787032079.284470:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.284483:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.284494:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857003648 00000100:00100000:1.0:1787032079.284504:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857003648 00000100:00100000:1.0:1787032079.284528:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787032079.284534:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857003648:12345-0@lo:256: 20000000:01000000:1.0:1787032079.284547:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787032079.284562:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787032079.284565:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787032079.284637:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857003648:12345-0@lo:256: Request processed in 103us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.284644:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787032079.284673:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003648:0@lo:256: 10000000:01000000:1.0:1787032079.284707:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787032079.284713:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284720:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032079.284728:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787032079.284731:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787032079.284733:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787032079.284749:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284755:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284763:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.284774:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003776:0@lo:101: 00000100:00100000:1.0:1787032079.284805:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.284818:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.284829:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857003776 00000100:00100000:1.0:1787032079.284832:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857003776 00000100:00100000:1.0:1787032079.284853:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787032079.284860:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857003776:12345-0@lo:101: 00010000:00010000:1.0:1787032079.284867:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032079.284876:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e96d3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284889:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284896:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.284903:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536c00, rc 0) 00000100:00100000:1.0:1787032079.284946:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857003776:12345-0@lo:101: Request processed in 86us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.284952:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787032079.284982:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003776:0@lo:101: 00010000:00010000:1.0:1787032079.284993:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.285001:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.285038:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003904:0@lo:501: 00000100:00100000:1.0:1787032079.285094:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.285112:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.285121:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857003904 00000100:00100000:1.0:1787032079.285124:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857003904 00000100:00100000:1.0:1787032079.285143:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787032079.285148:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857003904:12345-0@lo:501: 00000100:00100000:1.0:1787032079.285369:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857003904:12345-0@lo:501: Request processed in 220us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.285376:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787032079.285404:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857003904:0@lo:501: 00000100:00100000:1.0:1787032079.285428:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857004032:0@lo:503: 00000100:00100000:1.0:1787032079.285463:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.285477:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.285488:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857004032 00000100:00100000:1.0:1787032079.285491:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857004032 00000100:00100000:1.0:1787032079.285511:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787032079.285516:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857004032:12345-0@lo:503: 00000100:00100000:1.0:1787032079.285667:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857004032:12345-0@lo:503: Request processed in 150us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.285673:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787032079.285707:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857004032:0@lo:503: 00000100:00100000:3.0:1787032079.288001:0:6610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6610:1873838857004160:0@lo:502: 00000100:00100000:3.0:1787032079.288095:0:6610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032079.288142:0:6610:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc395ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787032079.288204:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857004160 00000100:00100000:2.0:1787032079.288212:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857004160 00000100:00100000:2.0:1787032079.288257:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787032079.288266:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:6610:x1873838857004160:12345-0@lo:502: 00000100:00100000:2.0:1787032079.288506:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:6610:x1873838857004160:12345-0@lo:502: Request processed in 240us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032079.288514:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787032079.288571:0:6610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6610:1873838857004160:0@lo:502: 00000020:01000000:2.0:1787032079.288598:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787032079.288606:0:6610:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787032079.288612:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032079.288614:0:6610:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787032079.288618:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787032079.288622:0:6610:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.148@tcp to nid 0x20000c0a8c994 (192.168.201.148@tcp) 00000020:01000000:2.0:1787032079.288644:0:6610:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787032079.288646:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787032079.288658:0:6610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cdc76f99c0) 00000020:00000080:2.0:1787032079.288677:0:6610:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787032079.288683:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787032079.288760:0:6610:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787032079.288765:0:6610:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787032079.288771:0:6610:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1e96e8 00010000:00080000:2.0:1787032079.288801:0:6610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccc1d84000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.148@tcp at head 00010000:00010000:2.0:1787032079.289040:0:6610:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787032079.394143:0:6610:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787032079.394168:0:6610:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787032079.394792:0:6610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787032079.395008:0:6610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787032079.395060:0:6610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787032079.395170:0:6610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787032079.399799:0:6611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787032079.399807:0:6611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787032079.405785:0:6610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787032079.405801:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787032079.405841:0:6610:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787032079.405860:0:6610:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1e96ef 00000100:00080000:1.0:1787032079.405871:0:6610:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787032079.405885:0:6610:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccc1d84000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:1.0:1787032079.406646:0:6610:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdf4875180 x1873838857004288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787032079.406674:0:6610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787032079.406746:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032079.406751:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032079.406753:0:6610:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787032079.406756:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787032079.406760:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032079.406762:0:6610:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787032079.406765:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787032079.406767:0:6610:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787032079.406798:0:6610:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6610:1873838857004416:0@lo:502: 00000100:00100000:1.0:1787032079.406881:0:6610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032079.407027:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857004288:0@lo:8: 00000100:00100000:3.0:1787032079.407064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.407169:0:6610:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.407191:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857004416 00000100:00100000:1.0:1787032079.407197:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857004416 00000100:00100000:1.0:1787032079.407233:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787032079.407241:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:6610:x1873838857004416:12345-0@lo:502: 00000100:00100000:0.0:1787032079.407557:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857004544:0@lo:400: 00000100:00100000:0.0:1787032079.407588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.407622:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787032079.407629:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857004672:0@lo:400: 00000100:00100000:0.0:1787032079.407658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032079.407741:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857004544 00000100:00100000:3.0:1787032079.407746:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857004544 00000100:00100000:3.0:1787032079.407776:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857004672 00000100:00100000:3.0:1787032079.407779:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857004672 00000100:00100000:3.0:1787032079.407802:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787032079.407808:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857004544:12345-0@lo:400: 00000100:00100000:3.0:1787032079.407854:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857004544:12345-0@lo:400: Request processed in 45us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032079.407861:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787032079.407876:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787032079.407883:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857004672:12345-0@lo:400: 00000100:00100000:2.0:1787032079.408556:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857004288 00000100:00100000:2.0:1787032079.408563:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857004288 00000100:00100000:2.0:1787032079.408586:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787032079.408591:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1873838857004288:12345-0@lo:8: 00000100:00100000:2.0:1787032079.408644:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1873838857004288:12345-0@lo:8: Request processed in 51us (1579us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787032079.408650:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787032079.408691:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787032079.408699:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99ccc1d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787032079.408704:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787032079.408707:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857004288:0@lo:8: 00000100:00100000:3.0:1787032079.409019:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857004672:12345-0@lo:400: Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032079.409027:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787032079.409049:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787032079.409089:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdca071500 x1873838857004544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032079.409100:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857004544:0@lo:400: 00010000:00080000:3.0:1787032079.409126:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdca070700 x1873838857004672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032079.409135:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857004672:0@lo:400: 00000100:00100000:1.0:1787032079.411642:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:6610:x1873838857004416:12345-0@lo:502: Request processed in 4393us (4753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.411655:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787032079.411744:0:6610:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6610:1873838857004416:0@lo:502: 00000020:01000000:1.0:1787032079.411773:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032079.411781:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032079.411783:0:6610:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787032079.411788:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787032079.411910:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787032079.412013:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787032079.412033:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.412044:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032079.412054:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787032079.412057:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cde4b73800 from 1 10000000:01000000:1.0:1787032079.412060:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787032079.412129:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.412138:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.412147:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.412165:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857004800:0@lo:101: 00000100:00100000:1.0:1787032079.412202:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.412230:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.412255:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857004800 00000100:00100000:1.0:1787032079.412260:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857004800 00000100:00100000:1.0:1787032079.412292:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787032079.412299:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857004800:12345-0@lo:101: 00010000:00010000:1.0:1787032079.412309:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032079.412322:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e96f6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.412344:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.412363:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.412372:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537000, rc 0) 00000100:00100000:1.0:1787032079.412400:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857004800:12345-0@lo:101: Request processed in 102us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.412406:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787032079.412438:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857004800:0@lo:101: 00010000:00010000:1.0:1787032079.412449:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.412457:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.412495:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857004928:0@lo:501: 00000100:00100000:1.0:1787032079.412519:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.412531:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.412544:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857004928 00000100:00100000:1.0:1787032079.412547:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857004928 00000100:00100000:1.0:1787032079.412568:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787032079.412574:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857004928:12345-0@lo:501: 00000100:00100000:1.0:1787032079.412812:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857004928:12345-0@lo:501: Request processed in 237us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.412819:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787032079.412847:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857004928:0@lo:501: 00000100:00100000:1.0:1787032079.412871:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857005056:0@lo:503: 00000100:00100000:1.0:1787032079.412911:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.413334:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.413432:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857005056 00000100:00100000:1.0:1787032079.413438:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857005056 00000100:00100000:1.0:1787032079.413465:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787032079.413473:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857005056:12345-0@lo:503: 00000100:00100000:1.0:1787032079.425587:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857005056:12345-0@lo:503: Request processed in 12106us (12666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.425601:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787032079.425720:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857005056:0@lo:503: 00000100:00100000:3.0:1787032079.428127:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6613:1873838857005184:0@lo:502: 00000100:00100000:3.0:1787032079.428210:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032079.428257:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc395c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.428577:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857005184 00000100:00100000:1.0:1787032079.428585:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857005184 00000100:00100000:1.0:1787032079.428628:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787032079.428636:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:6613:x1873838857005184:12345-0@lo:502: 00000100:00100000:1.0:1787032079.431444:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:6613:x1873838857005184:12345-0@lo:502: Request processed in 2800us (3225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.431458:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787032079.431596:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6613:1873838857005184:0@lo:502: 00000020:01000000:0.0:1787032079.431630:0:6613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032079.431640:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032079.431643:0:6613:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787032079.431650:0:6613:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cde4b73800 00000020:00000080:0.0:1787032079.431653:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787032079.431690:0:6613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca070380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6613:1873838857005312:0@lo:502: 00000100:00100000:0.0:1787032079.431736:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.431774:0:6613:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5be40 going to sleep for 11 seconds 00002000:00080000:2.0:1787032079.431873:0:6582:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787032079.431885:0:6582:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787032079.432047:0:6582:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787032079.432128:0:6582:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787032079.432145:0:6582:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787032079.432190:0:6582:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000100:00100000:1.0:1787032079.435109:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857005312 00000100:00100000:1.0:1787032079.435123:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857005312 00000100:00100000:1.0:1787032079.435177:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787032079.435187:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+15:6613:x1873838857005312:12345-0@lo:502: 00000100:00100000:1.0:1787032079.435444:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+15:6613:x1873838857005312:12345-0@lo:502: Request processed in 259us (3706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032079.435453:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787032079.437536:0:6613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca070380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:6613:1873838857005312:0@lo:502: 00000020:01000000:1.0:1787032079.437575:0:6613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032079.437589:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032079.437591:0:6613:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787032079.437597:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787032079.437712:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787032079.437730:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787032079.437740:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.437753:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032079.437763:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787032079.437765:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99cdc7654d40 from 1 10000000:01000000:1.0:1787032079.437768:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787032079.437801:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.437808:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.437816:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.437835:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857005440:0@lo:101: 00000100:00100000:1.0:1787032079.437890:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032079.452508:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857005440 00000100:00100000:0.0:1787032079.452523:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857005440 00000100:00100000:0.0:1787032079.452583:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787032079.452593:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857005440:12345-0@lo:101: 00010000:00010000:0.0:1787032079.452610:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032079.452628:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9704 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.452656:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.452667:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032079.452676:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030000, rc 0) 00000100:00100000:0.0:1787032079.452743:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857005440:12345-0@lo:101: Request processed in 152us (14852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032079.452750:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787032079.453203:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032079.453231:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857005440:0@lo:101: 00010000:00010000:1.0:1787032079.453248:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.453258:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032079.453331:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857005568:0@lo:501: 00000100:00100000:1.0:1787032079.454029:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032079.454102:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032079.454191:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857005568 00000100:00100000:0.0:1787032079.454197:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857005568 00000100:00100000:0.0:1787032079.454239:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787032079.454247:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857005568:12345-0@lo:501: 00000100:00100000:0.0:1787032079.454571:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857005568:12345-0@lo:501: Request processed in 324us (544us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032079.454579:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787032079.454669:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857005568:0@lo:501: 10000000:01000000:1.0:1787032079.454700:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787032079.454709:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032079.454718:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032080.001300:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032081.029035:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032082.049306:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032083.077095:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032084.102557:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787032084.739581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787032084.739591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787032084.739595:0:8:0:(import.c:65:import_set_state_nolock()) ffff99ccc1d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787032084.739606:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccc1d84000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:3.0:1787032084.739626:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ce011a3100 x1873838857006080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787032084.739659:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857005696:0@lo:400: 00000100:00100000:3.0:1787032084.739720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032084.739776:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857005824:0@lo:400: 00000100:00100000:3.0:1787032084.739802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032084.739835:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787032084.739840:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857005952:0@lo:400: 00000100:00100000:3.0:1787032084.739862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032084.739886:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857006080:0@lo:8: 00000100:00100000:3.0:1787032084.739912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032084.739943:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857005696 00000100:00100000:3.0:1787032084.739950:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857005696 00000100:00100000:3.0:1787032084.739989:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787032084.739997:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:3303:x1873838857005696:12345-0@lo:400: 00000100:00100000:3.0:1787032084.740043:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:3303:x1873838857005696:12345-0@lo:400: Request processed in 47us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032084.740050:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787032084.740099:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857005824 00000100:00100000:3.0:1787032084.740113:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857005824 00000100:00100000:3.0:1787032084.740137:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857005952 00000100:00100000:3.0:1787032084.740140:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857005952 00000100:00100000:3.0:1787032084.740163:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787032084.740168:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857005824:12345-0@lo:400: 00000100:00100000:3.0:1787032084.740203:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857005824:12345-0@lo:400: Request processed in 35us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032084.740209:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787032084.740221:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787032084.740227:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857005952:12345-0@lo:400: 00000100:00100000:3.0:1787032084.740251:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857005952:12345-0@lo:400: Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032084.740372:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787032084.740411:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857005696:0@lo:400: 00000100:00080000:3.0:1787032084.740434:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787032084.740451:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ce011a0a80 x1873838857005952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032084.740462:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857005952:0@lo:400: 00010000:00080000:3.0:1787032084.740472:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ce011a3480 x1873838857005824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032084.740479:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857005824:0@lo:400: 00000100:00100000:3.0:1787032084.753265:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857006080 00000100:00100000:3.0:1787032084.753282:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857006080 00000100:00100000:3.0:1787032084.753332:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032084.753340:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3301:x1873838857006080:12345-0@lo:8: 00000100:00100000:1.0:1787032084.753340:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787032084.753349:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:3.0:1787032084.753380:0:6587:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1787032084.753412:0:6587:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1e9712 00002000:00100000:3.0:1787032084.753450:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cdefa9c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113701 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787032084.753455:0:6587:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787032084.753459:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787032084.753585:0:6587:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787032084.753716:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787032084.753752:0:6587:0:(import.c:65:import_set_state_nolock()) ffff99cdefa98800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787032084.753854:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1873838857006080:12345-0@lo:8: Request processed in 513us (13940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032084.753862:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787032084.753945:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ce011a3100 x1873838857006080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787032094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787032084.753962:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787032084.753970:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787032084.753975:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787032084.753977:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99ccc1d84000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787032084.753996:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787032084.754002:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857006080:0@lo:8: 00000004:00080000:3.0:1787032084.754559:0:6611:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787032084.754720:0:6611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 239600651109ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787032084.836153:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787032084.836189:0:6612:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787032084.836213:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6612:1873838857006336:0@lo:7: 00000100:00100000:0.0:1787032084.836295:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032084.836340:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857006208:0@lo:13: 00000100:00100000:0.0:1787032084.836358:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb7919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032084.836369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032084.836396:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857006208 00000100:00100000:0.0:1787032084.836403:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857006208 00000100:00080000:3.0:1787032084.836429:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787032084.836456:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032084.836465:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857006208:12345-0@lo:13: 00000100:00100000:2.0:1787032084.836486:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857006336 00000100:00100000:2.0:1787032084.836490:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857006336 00002000:00000024:0.0:1787032084.836499:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787032084.836517:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032084.836523:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6612:x1873838857006336:12345-0@lo:7: 00000100:00100000:0.0:1787032084.836542:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857006208:12345-0@lo:13: Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032084.836548:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787032084.839381:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdca073b80 x1873838857006208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032084.839405:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857006208:0@lo:13: 00002000:00080000:0.0:1787032084.843224:0:6586:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787032084.843232:0:6586:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787032084.843315:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6612:x1873838857006336:12345-0@lo:7: Request processed in 6787us (7015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032084.843327:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787032084.843378:0:6612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdca071f80 x1873838857006336/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787032100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032084.843392:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6612:1873838857006336:0@lo:7: 00000004:00080000:0.0:1787032084.843410:0:6612:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787032084.843445:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6612:1873838857006464:0@lo:5: 00000100:00100000:0.0:1787032084.843473:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032084.843508:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb7919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032084.843523:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857006464 00000100:00100000:0.0:1787032084.843528:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857006464 00000100:00100000:0.0:1787032084.843561:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787032084.843568:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6612:x1873838857006464:12345-0@lo:5: 00002000:00080000:0.0:1787032084.843590:0:6586:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787032084.843593:0:6586:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787032084.843780:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6612:x1873838857006464:12345-0@lo:5: Request processed in 211us (305us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787032084.843786:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787032084.843806:0:6612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdca071f80 x1873838857006464/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787032100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032084.843830:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6612:1873838857006464:0@lo:5: 00000004:00080000:0.0:1787032084.843837:0:6612:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787032084.843857:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6612:1873838857006592:0@lo:700: 00000100:00100000:0.0:1787032084.843878:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032084.843893:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb7919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032084.843919:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857006592 00000100:00100000:0.0:1787032084.843923:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857006592 00000100:00100000:0.0:1787032084.843947:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032084.843952:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6612:x1873838857006592:12345-0@lo:700: 00000100:00100000:0.0:1787032084.843974:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6593:1873838857006720:0@lo:700: 00000100:00100000:0.0:1787032084.843997:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032084.844017:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032084.844036:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857006720 00000100:00100000:0.0:1787032084.844039:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857006720 00000100:00100000:0.0:1787032084.844059:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032084.844064:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6593:x1873838857006720:12345-0@lo:700: 40000000:02000000:0.0:1787032084.883933:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787032084.894530:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6593:x1873838857006720:12345-0@lo:700: Request processed in 50457us (50524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032084.894545:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787032084.894588:0:6593:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdca072680 x1873838857006720/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787032100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032084.894604:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6593:1873838857006720:0@lo:700: 40000000:02000000:1.0:1787032084.894625:0:6593:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1787032084.961641:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6612:x1873838857006592:12345-0@lo:700: Request processed in 117679us (117752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032084.961656:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787032084.961711:0:6612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdca073480 x1873838857006592/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787032100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032084.961723:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6612:1873838857006592:0@lo:700: 00000001:00080000:3.0:1787032084.964507:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787032084.964524:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1787032084.995126:0:6612:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787032085.002502:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6612:1873838857006848:0@lo:5: 00000100:00100000:0.0:1787032085.002571:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032085.002685:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032085.003649:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857006848 00000100:00100000:2.0:1787032085.003657:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857006848 00000100:00100000:2.0:1787032085.003705:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787032085.003715:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6612:x1873838857006848:12345-0@lo:5: 00002000:00080000:2.0:1787032085.009704:0:6587:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787032085.009728:0:6587:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787032085.013714:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6612:x1873838857006848:12345-0@lo:5: Request processed in 9994us (11136us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787032085.013728:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787032085.013794:0:6612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdca073480 x1873838857006848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787032101 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032085.013807:0:6612:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787032085.013835:0:6612:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff99cdca073480 x1873838857006848/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787032101 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032085.013846:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6612:1873838857006848:0@lo:5: 00000004:00080000:0.0:1787032085.013859:0:6612:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787032085.122019:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787032085.588648:0:6958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787032086.146459:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032087.179478:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032088.194675:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032089.221402:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032089.859283:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857006976:0@lo:400: 00000100:00100000:1.0:1787032089.859352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032089.859406:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787032089.859413:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857007360:0@lo:400: 00000100:00100000:1.0:1787032089.859440:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032089.859472:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857007104:0@lo:400: 00000100:00100000:1.0:1787032089.859498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032089.859516:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032089.859521:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857007232:0@lo:400: 00000100:00100000:1.0:1787032089.859541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032089.859571:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857007360 00000100:00100000:1.0:1787032089.859577:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857007360 00000100:00100000:1.0:1787032089.859632:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787032089.859641:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857007360:12345-0@lo:400: 00000100:00100000:1.0:1787032089.859705:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857007360:12345-0@lo:400: Request processed in 65us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032089.859713:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787032089.859754:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857007104 00000100:00100000:1.0:1787032089.859758:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857007104 00010000:00080000:3.0:1787032089.859761:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdf4875880 x1873838857007360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032089.859777:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857007360:0@lo:400: 00000100:00100000:1.0:1787032089.859785:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857007232 00000100:00100000:1.0:1787032089.859789:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857007232 00000100:00100000:1.0:1787032089.859811:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787032089.859829:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857007104:12345-0@lo:400: 00000100:00100000:1.0:1787032089.859866:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857007104:12345-0@lo:400: Request processed in 39us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032089.859873:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787032089.859889:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787032089.859897:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857007232:12345-0@lo:400: 00010000:00080000:3.0:1787032089.859905:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdf4876a00 x1873838857007104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032089.859924:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857007104:0@lo:400: 00000100:00100000:1.0:1787032089.859929:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857007232:12345-0@lo:400: Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032089.859936:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787032089.859953:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdf4876300 x1873838857007232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787032089.859957:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787032089.859963:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032089.859966:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857007232:0@lo:400: 00000100:00100000:0.0:1787032089.860096:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857006976 00000100:00100000:0.0:1787032089.860101:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857006976 00000100:00100000:0.0:1787032089.860128:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787032089.860136:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:3303:x1873838857006976:12345-0@lo:400: 00000100:00100000:0.0:1787032089.860171:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:3303:x1873838857006976:12345-0@lo:400: Request processed in 37us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032089.860177:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787032089.860279:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787032089.860288:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857007488:0@lo:13: 00000100:00100000:1.0:1787032089.860315:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032089.860356:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857006976:0@lo:400: 00000100:00100000:3.0:1787032089.860396:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857007488 00000100:00100000:3.0:1787032089.860401:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857007488 00000100:00100000:3.0:1787032089.860597:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032089.860607:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857007488:12345-0@lo:13: 00002000:00000024:3.0:1787032089.860640:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032089.860697:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857007488:12345-0@lo:13: Request processed in 92us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032089.860703:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787032089.860756:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdca071f80 x1873838857007488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032089.860772:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857007488:0@lo:13: 00010000:00010000:1.0:1787032090.242613:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787032090.380814:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787032091.267392:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032092.289240:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032093.315362:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032094.338762:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032094.977355:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787032094.977378:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857007616:0@lo:400: 00000100:00100000:1.0:1787032094.977444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032094.977553:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857007872:0@lo:400: 00000100:00100000:2.0:1787032094.977658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032094.977680:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032094.977685:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857008000:0@lo:400: 00000100:00100000:2.0:1787032094.977711:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032094.977748:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857007872 00000100:00100000:2.0:1787032094.977755:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857007872 00000100:00100000:2.0:1787032094.977813:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787032094.977822:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857007872:12345-0@lo:400: 00000100:00100000:2.0:1787032094.977883:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857007872:12345-0@lo:400: Request processed in 64us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032094.977889:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787032094.977908:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857008000 00000100:00100000:2.0:1787032094.977910:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857008000 00000100:00100000:2.0:1787032094.977927:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787032094.977931:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857008000:12345-0@lo:400: 00000100:00100000:2.0:1787032094.977951:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857008000:12345-0@lo:400: Request processed in 20us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032094.977955:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787032094.977966:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032094.977969:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787032094.977993:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc8d5b480 x1873838857008000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032094.978002:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787032094.978017:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857008000:0@lo:400: 00010000:00080000:2.0:1787032094.978023:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc8d58e00 x1873838857007872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032094.978029:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857007872:0@lo:400: 00000100:00100000:3.0:1787032094.978094:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787032094.978102:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857007744:0@lo:400: 00000100:00100000:3.0:1787032094.978125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032094.978226:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857007616 00000100:00100000:0.0:1787032094.978230:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857007616 00000100:00100000:0.0:1787032094.978250:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787032094.978254:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:3305:x1873838857007616:12345-0@lo:400: 00000100:00100000:0.0:1787032094.978373:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:3305:x1873838857007616:12345-0@lo:400: Request processed in 118us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032094.978377:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787032094.978494:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857007616:0@lo:400: 00000100:00100000:1.0:1787032094.978703:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857008128:0@lo:13: 00000100:00100000:2.0:1787032094.978716:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857007744 00000100:00100000:2.0:1787032094.978719:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857007744 00000100:00100000:1.0:1787032094.978731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032094.978744:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787032094.978750:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857007744:12345-0@lo:400: 00000100:00100000:1.0:1787032094.978762:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857008128 00000100:00100000:1.0:1787032094.978765:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857008128 00000100:00100000:2.0:1787032094.978787:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857007744:12345-0@lo:400: Request processed in 37us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032094.978787:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787032094.978793:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857008128:12345-0@lo:13: 00000100:00100000:2.0:1787032094.978794:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787032094.978827:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc8d5a680 x1873838857007744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1787032094.978827:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032094.978836:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857007744:0@lo:400: 00000100:00100000:1.0:1787032094.978861:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857008128:12345-0@lo:13: Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032094.978868:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787032094.978879:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ce011a0e00 x1873838857008128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032094.978891:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857008128:0@lo:13: 00010000:00010000:0.0:1787032095.362037:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787032095.396995:0:7482:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787032095.396999:0:7482:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787032095.397449:0:7482:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99cdc4c91800 00000020:01000004:3.0:1787032095.397464:0:7482:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787032095.397477:0:7482:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787032095.397490:0:7482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99cdc8184d40) 00000020:00000080:3.0:1787032095.397508:0:7482:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787032095.410911:0:7482:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787032095.411342:0:7482:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787032095.435283:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787032095.443004:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787032095.443041:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787032095.443328:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787032095.443359:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787032095.443716:0:7482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787032095.443728:0:7482:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787032095.443739:0:7482:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd047797ef1e9720 00000020:01000004:2.0:1787032095.443747:0:7482:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787032095.443768:0:7482:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787032095.443772:0:7482:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787032095.443777:0:7482:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787032095.443799:0:7482:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787032095.443803:0:7482:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787032095.464955:0:7482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787032095.464998:0:7482:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.148@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787032095.465002:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787032095.465007:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787032095.465008:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032095.465009:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032095.465010:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032095.465012:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032095.465013:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032095.465015:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787032095.465016:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787032095.465017:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032095.465018:0:7482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787032095.465022:0:7482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787032095.465024:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787032095.465025:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787032095.465026:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032095.465027:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032095.465028:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032095.465029:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032095.465030:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032095.465031:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787032095.465032:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787032095.465032:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032095.465033:0:7482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787032095.465060:0:7482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787032095.465339:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857008256:0@lo:253: 00000100:00100000:3.0:1787032095.465479:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.465579:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787032095.465639:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857008256 00000100:00100000:0.0:1787032095.465647:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857008256 00000100:00100000:0.0:1787032095.465733:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787032095.465743:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:7482:x1873838857008256:12345-0@lo:253: 20000000:01000000:0.0:1787032095.465783:0:5790:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787032095.465788:0:5790:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787032095.465798:0:5790:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787032095.465802:0:5790:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787032095.468156:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787032095.468588:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787032095.468606:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787032095.468671:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787032095.468680:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787032095.468713:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787032095.468765:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787032095.469201:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787032095.469586:0:5790:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.148@tcp 20000000:01000000:1.0:1787032095.469589:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.148@tcp (null) (null) (null) 00000040:00080000:1.0:1787032095.469649:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787032095.469659:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787032095.469714:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787032095.469722:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.148@tcp (null) (null) 00000040:00080000:1.0:1787032095.469754:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787032095.469764:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787032095.469796:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787032095.469850:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787032095.470784:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787032095.470803:0:5790:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.148@tcp 20000000:01000000:1.0:1787032095.470805:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.148@tcp (null) (null) (null) 00000040:00080000:1.0:1787032095.470859:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787032095.470868:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787032095.470900:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787032095.470908:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.148@tcp (null) (null) 00000040:00080000:1.0:1787032095.470939:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787032095.470947:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787032095.470992:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787032095.471032:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787032095.471048:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787032095.471051:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787032095.471056:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787032095.471058:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787032095.471496:0:5790:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787032095.471517:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787032095.471520:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787032095.471556:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787032095.471559:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787032095.472018:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787032095.472173:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787032095.472435:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787032095.472728:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787032095.472769:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787032095.472827:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787032095.472839:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787032095.472842:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787032095.473474:0:7485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787032095.473522:0:7485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787032095.473576:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787032095.474174:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787032095.474231:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787032095.474269:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787032095.474280:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787032095.474282:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787032095.474827:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787032095.475014:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787032095.475054:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787032095.475327:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787032095.475340:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787032095.475343:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787032095.478868:0:7487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787032095.478962:0:7487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787032095.478992:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787032095.481866:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787032095.481919:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787032095.482013:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1787032095.482032:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787032095.482052:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.482952:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc1536600/0xcd047797ef1e966a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.482962:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e968d expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.482970:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.482986:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.482993:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.483000:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.483041:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.483056:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 16 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032095.483294:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008384:0@lo:104: 00000100:00100000:1.0:1787032095.483427:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787032095.483524:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.483533:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 16 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032095.483542:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008512:0@lo:104: 00010000:00010000:1.0:1787032095.483567:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.483575:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 16 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032095.483598:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008640:0@lo:104: 00010000:00010000:1.0:1787032095.483634:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e968d expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.483642:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e968d expref: 16 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032095.483651:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008768:0@lo:104: 00010000:00010000:1.0:1787032095.483677:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc1536600/0xcd047797ef1e966a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.483685:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc1536600/0xcd047797ef1e966a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 16 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032095.483693:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008896:0@lo:104: 00000100:00100000:1.0:1787032095.483726:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cbab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787032095.483790:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787032095.483809:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.483874:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.483922:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.483940:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857008384 00000100:00100000:3.0:1787032095.483947:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857008384 00000100:00100000:3.0:1787032095.483982:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857008512 00000100:00100000:3.0:1787032095.483985:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857008512 00000100:00100000:3.0:1787032095.483992:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857008640 00000100:00100000:3.0:1787032095.483993:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857008640 00000100:00100000:3.0:1787032095.484004:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787032095.484011:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdcb7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:5790:x1873838857008384:12345-0@lo:104: 00010000:00010000:3.0:1787032095.484023:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.484254:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787032095.484260:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdcb7c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:5790:x1873838857008384:12345-0@lo:104: Request processed in 249us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.484267:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787032095.484309:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787032095.484316:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:5790:x1873838857008512:12345-0@lo:104: 00010000:00010000:3.0:1787032095.484324:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032095.484468:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.484475:0:5780:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787032095.484481:0:5780:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1787032095.484616:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857008768 00000100:00100000:2.0:1787032095.484620:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857008768 00000100:00100000:2.0:1787032095.484647:0:5780:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787032095.484653:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857008896 00000100:00100000:2.0:1787032095.484655:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857008896 00000100:00100000:2.0:1787032095.484733:0:7488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787032095.484741:0:7488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0402f217-6678-4505-97bf-ca0cb32c7313+6:5790:x1873838857008640:12345-0@lo:104: 00010000:00010000:2.0:1787032095.484749:0:7488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032095.484841:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008384:0@lo:104: 00000100:00100000:1.0:1787032095.484850:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008512:0@lo:104: 00000100:00100000:1.0:1787032095.484856:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008640:0@lo:104: 00010000:00010000:0.0:1787032095.485245:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787032095.485254:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485262:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537200 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032095.485266:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485275:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032095.485281:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032095.485287:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032095.485331:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485338:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032095.485369:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485389:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1537200/0xcd047797ef1e9704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e970b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485402:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787032095.485406:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485412:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032095.485415:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485421:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032095.485427:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032095.485432:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032095.485447:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485453:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032095.485467:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485474:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1536400/0xcd047797ef1e96d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96da expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485484:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032095.485492:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485498:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ce02046a00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032095.485501:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485508:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032095.485515:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032095.485520:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032095.485534:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485541:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032095.485547:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485553:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e96b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96be expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485565:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032095.485567:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032095.485569:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032095.485583:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857009024:0@lo:103: 00000100:00100000:0.0:1787032095.485634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.485684:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857009152:0@lo:103: 00000100:00100000:0.0:1787032095.485719:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.485739:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032095.485745:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857009280:0@lo:103: 00000100:00100000:0.0:1787032095.485764:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.485794:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857009024 00000100:00100000:0.0:1787032095.485798:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857009024 00010000:00010000:0.0:1787032095.485819:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 17 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032095.485835:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857009152 00000100:00100000:0.0:1787032095.485837:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857009152 00010000:00010000:0.0:1787032095.485848:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 18 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032095.485857:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857009280 00000100:00100000:0.0:1787032095.485860:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857009280 00010000:00010000:0.0:1787032095.485869:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 19 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032095.485880:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787032095.485886:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857009024:12345-0@lo:103: 00010000:00010000:0.0:1787032095.485897:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032095.485902:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 19 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485913:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 19 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485927:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e970b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9704 expref: 19 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.485950:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032095.485978:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+18:3305:x1873838857009024:12345-0@lo:103: Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.485986:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787032095.486003:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032095.486009:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+17:3302:x1873838857009152:12345-0@lo:103: 00010000:00010000:0.0:1787032095.486016:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032095.486020:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 17 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.486029:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 17 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.486039:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1e96da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e96d3 expref: 17 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.486048:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032095.486101:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+16:3302:x1873838857009152:12345-0@lo:103: Request processed in 92us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.486107:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032095.486119:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787032095.486125:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+15:3302:x1873838857009280:12345-0@lo:103: 00010000:00010000:0.0:1787032095.486132:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032095.486136:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 15 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.486145:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 15 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.486162:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ce02047c00/0xcd047797ef1e96be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e96b7 expref: 15 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.486171:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032095.486194:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+14:3302:x1873838857009280:12345-0@lo:103: Request processed in 69us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.486200:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787032095.486233:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857009024:0@lo:103: 00000100:00100000:0.0:1787032095.486258:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857009280:0@lo:103: 00000100:00100000:0.0:1787032095.486265:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857009152:0@lo:103: 00010000:00010000:3.0:1787032095.491256:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787032095.491278:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+6:5790:x1873838857008512:12345-0@lo:104: Request processed in 6956us (7461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.491292:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787032095.491336:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787032095.491363:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:5790:x1873838857008768:12345-0@lo:104: 00010000:00010000:3.0:1787032095.491382:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.491492:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787032095.491498:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:5790:x1873838857008768:12345-0@lo:104: Request processed in 155us (7575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.491504:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787032095.491517:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787032095.491523:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:5790:x1873838857008896:12345-0@lo:104: 00010000:00010000:3.0:1787032095.491531:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1e9663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.491573:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787032095.491579:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:5790:x1873838857008896:12345-0@lo:104: Request processed in 56us (7111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.491585:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787032095.491795:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787032095.491805:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491812:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032095.491816:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491825:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032095.491831:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032095.491836:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032095.491882:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491898:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032095.491916:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491923:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e968d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9694 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491935:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032095.491938:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1e9663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491944:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537c00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032095.491947:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1e9663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491953:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1e9663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032095.491959:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1e9663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032095.491963:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032095.491975:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1e9663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491980:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032095.491984:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1e9663 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.491990:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1e9663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e966a expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492009:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032095.492011:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032095.492013:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032095.492027:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857009408:0@lo:103: 00000100:00100000:0.0:1787032095.492091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.492128:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787032095.492134:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857009536:0@lo:103: 00000100:00100000:0.0:1787032095.492154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.492180:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857009408 00000100:00100000:0.0:1787032095.492186:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857009408 00010000:00010000:0.0:1787032095.492318:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e968d expref: 14 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032095.492356:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857009536 00000100:00100000:0.0:1787032095.492360:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857009536 00010000:00010000:0.0:1787032095.492373:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc1536600/0xcd047797ef1e966a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 15 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032095.492385:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787032095.492391:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+15:3304:x1873838857009408:12345-0@lo:103: 00010000:00010000:0.0:1787032095.492402:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032095.492408:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e968d expref: 15 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492418:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e968d expref: 15 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492438:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032095.492473:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+15:3304:x1873838857009408:12345-0@lo:103: Request processed in 82us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.492480:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787032095.492492:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787032095.492497:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+14:3304:x1873838857009536:12345-0@lo:103: 00010000:00010000:0.0:1787032095.492504:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032095.492508:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc1536600/0xcd047797ef1e966a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 14 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492516:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc1536600/0xcd047797ef1e966a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 14 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492529:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492539:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492556:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492563:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492571:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492579:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492584:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032095.492595:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492603:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492612:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492631:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032095.492655:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+14:3304:x1873838857009536:12345-0@lo:103: Request processed in 158us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.492662:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787032095.492707:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857009536:0@lo:103: 00000100:00100000:0.0:1787032095.492716:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857009408:0@lo:103: 00010000:00010000:0.0:1787032095.492736:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032095.492777:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e968d expref: 13 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032095.492787:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008768:0@lo:104: 00010000:00010000:0.0:1787032095.492797:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1536600/0xcd047797ef1e966a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9663 expref: 12 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032095.492804:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1873838857008896:0@lo:104: 00010000:00010000:0.0:1787032095.492825:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492834:0:5790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492852:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.492858:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7775e00/0xcd047797ef1e9727 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787032095.492870:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1787032095.493261:0:7488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787032095.493270:0:7488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0402f217-6678-4505-97bf-ca0cb32c7313+3:5790:x1873838857008640:12345-0@lo:104: Request processed in 8530us (9394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.493277:0:7488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787032095.493656:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032095.542107:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+11:7482:x1873838857008256:12345-0@lo:253: Request processed in 76356us (76618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.542122:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787032095.542999:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857008256:0@lo:253: 10000000:01000000:3.0:1787032095.543015:0:7482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787032095.543019:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787032095.543020:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787032095.543022:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032095.543023:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787032095.543025:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032095.543026:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032095.543028:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032095.543029:0:7482:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787032095.543031:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032095.543033:0:7482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787032095.543056:0:7482:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cdc4c91800 from lustre-OST0001 10000000:01000000:3.0:1787032095.543109:0:7482:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787032095.543113:0:7482:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787032095.543120:0:7482:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cdc7654d40 local copy 10000000:01000000:3.0:1787032095.543124:0:7482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787032095.543162:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.543174:0:7482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.543183:0:7482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032095.543203:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857009664:0@lo:101: 00000100:00100000:3.0:1787032095.543271:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.543311:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787032095.543616:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857009664 00000100:00100000:2.0:1787032095.543632:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857009664 00000100:00100000:2.0:1787032095.543676:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787032095.543686:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+11:7482:x1873838857009664:12345-0@lo:101: 00010000:00010000:2.0:1787032095.543699:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032095.543719:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6600/0xcd047797ef1e9735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e972e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.543743:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6600/0xcd047797ef1e9735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e972e expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.543754:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6600/0xcd047797ef1e9735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e972e expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.543763:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6600, rc 0) 00000100:00100000:2.0:1787032095.543799:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857009664:12345-0@lo:101: Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.543806:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787032095.544107:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857009664:0@lo:101: 00010000:00010000:0.0:1787032095.544122:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.544131:0:7482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032095.544243:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857009792:0@lo:501: 00000100:00100000:0.0:1787032095.544274:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.544301:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc2f50000 going to sleep for 11 seconds 00000100:00100000:2.0:1787032095.544518:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857009792 00000100:00100000:2.0:1787032095.544522:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857009792 00000100:00100000:2.0:1787032095.544545:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787032095.544552:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857009792:12345-0@lo:501: 00000100:00100000:2.0:1787032095.544774:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857009792:12345-0@lo:501: Request processed in 222us (499us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787032095.544780:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787032095.544811:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857009792:0@lo:501: 10000000:01000000:2.0:1787032095.544827:0:7482:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787032095.544854:0:7482:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787032095.544859:0:7482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.544867:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.544884:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.544899:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787032095.544918:0:7482:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cdc4c91800 10000000:01000000:2.0:1787032095.544923:0:7482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787032095.544928:0:7482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787032095.544931:0:7482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787032095.544935:0:7482:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787032095.544938:0:7482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787032095.544956:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.544963:0:7482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.544971:0:7482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032095.544983:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857009920:0@lo:101: 00000100:00100000:2.0:1787032095.545009:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.545028:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857009920 00000100:00100000:2.0:1787032095.545031:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857009920 00000100:00100000:2.0:1787032095.545047:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787032095.545053:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857009920:12345-0@lo:101: 00010000:00010000:2.0:1787032095.545146:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032095.545157:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e973c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.545184:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e973c expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.545193:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e973c expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.545201:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7400, rc 0) 00000100:00100000:2.0:1787032095.545346:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857009920:12345-0@lo:101: Request processed in 291us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.545352:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787032095.545379:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b1a780 going to sleep for 11 seconds 00000100:00100000:2.0:1787032095.545390:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857009920:0@lo:101: 00010000:00010000:2.0:1787032095.545400:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.545408:0:7482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032095.545463:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010048:0@lo:501: 00000100:00100000:2.0:1787032095.545487:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.545543:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b1a780 going to sleep for 11 seconds 00010000:00010000:0.0:1787032095.545598:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032095.545603:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.545611:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ce02047600 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032095.545615:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.545644:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032095.545651:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032095.545657:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032095.545674:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.545679:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032095.545705:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.545713:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99ce02047600/0xcd047797ef1e972e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd047797ef1e9735 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.545728:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032095.545730:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032095.545731:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032095.545739:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787032095.545749:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857010176:0@lo:103: 00000100:00100000:0.0:1787032095.545778:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.545805:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857010176 00000100:00100000:0.0:1787032095.545809:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857010176 00000100:00100000:0.0:1787032095.545838:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032095.545845:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+13:3303:x1873838857010176:12345-0@lo:103: 00010000:00010000:0.0:1787032095.545855:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032095.545868:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6600/0xcd047797ef1e9735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e972e expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.545884:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032095.545911:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+12:3303:x1873838857010176:12345-0@lo:103: Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.545917:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032095.545947:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857010176:0@lo:103: 00000100:00100000:3.0:1787032095.546664:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857010048 00000100:00100000:3.0:1787032095.546670:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857010048 00000100:00100000:2.0:1787032095.546994:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787032095.547003:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010048:12345-0@lo:501: 00000100:00100000:2.0:1787032095.547330:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010048:12345-0@lo:501: Request processed in 327us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.547337:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787032095.547510:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010048:0@lo:501: 00000100:00100000:3.0:1787032095.547555:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010304:0@lo:503: 00000100:00100000:3.0:1787032095.547597:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.547638:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032095.547763:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857010304 00000100:00100000:0.0:1787032095.547768:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857010304 00000100:00100000:0.0:1787032095.547802:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787032095.547809:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010304:12345-0@lo:503: 00000100:00100000:0.0:1787032095.548038:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010304:12345-0@lo:503: Request processed in 228us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.548044:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787032095.548381:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010304:0@lo:503: 00000040:00080000:1.0:1787032095.548688:0:7482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787032095.548748:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010432:0@lo:502: 00000100:00100000:1.0:1787032095.548788:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032095.548858:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cbaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032095.548898:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857010432 00000100:00100000:3.0:1787032095.548902:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857010432 00000100:00100000:3.0:1787032095.548962:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787032095.548969:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010432:12345-0@lo:502: 00000100:00100000:3.0:1787032095.549142:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010432:12345-0@lo:502: Request processed in 172us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.549148:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787032095.549379:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010432:0@lo:502: 00000040:00080000:1.0:1787032095.549616:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787032095.549678:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787032095.549711:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787032095.549754:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787032095.549787:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787032095.549819:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787032095.549846:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010560:0@lo:502: 00000100:00100000:1.0:1787032095.549886:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032095.550091:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cbaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032095.550316:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857010560 00000100:00100000:0.0:1787032095.550322:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857010560 00000100:00100000:0.0:1787032095.550349:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787032095.550355:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010560:12345-0@lo:502: 00000100:00100000:0.0:1787032095.550521:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010560:12345-0@lo:502: Request processed in 165us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.550529:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787032095.551727:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010560:0@lo:502: 00000040:00080000:1.0:1787032095.551902:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787032095.551916:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787032095.552703:0:7491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787032095.552711:0:7491:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787032095.552718:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032095.552720:0:7491:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787032095.552727:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787032095.552749:0:7491:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99cdefc199c0) 00000020:00000080:0.0:1787032095.552771:0:7491:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787032095.552779:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787032095.552852:0:7491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdc4c91800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787032095.552861:0:7491:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787032095.552868:0:7491:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd047797ef1e9751 00010000:00010000:0.0:1787032095.560948:0:7491:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787032095.562547:0:7491:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787032095.566452:0:7491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787032095.566762:0:7491:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787032095.576610:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787032095.577497:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787032095.579856:0:7491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787032095.579871:0:7491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787032095.579878:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032095.579880:0:7491:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787032095.579883:0:7491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787032095.579888:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032095.579889:0:7491:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787032095.579893:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787032095.579894:0:7491:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787032095.579950:0:7491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787032095.579955:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032095.579956:0:7491:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787032095.579959:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787032095.580704:0:7482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787032095.580731:0:7482:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787032095.580845:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.580858:0:7482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032095.580866:0:7482:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdc4c91800 from 1 10000000:01000000:3.0:1787032095.580869:0:7482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787032095.580907:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.580915:0:7482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.580937:0:7482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032095.580962:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010688:0@lo:101: 00000100:00100000:3.0:1787032095.581033:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.581105:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787032095.582230:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857010688 00000100:00100000:0.0:1787032095.582240:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857010688 00000100:00100000:0.0:1787032095.582293:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787032095.582303:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+12:7482:x1873838857010688:12345-0@lo:101: 00010000:00010000:0.0:1787032095.582319:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032095.582335:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9758 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.582361:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.582372:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.582381:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030000, rc 0) 00000100:00100000:0.0:1787032095.582435:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857010688:12345-0@lo:101: Request processed in 133us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032095.582441:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787032095.583750:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010688:0@lo:101: 00010000:00010000:3.0:1787032095.583774:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.583785:0:7482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032095.583900:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010816:0@lo:501: 00000100:00100000:3.0:1787032095.583950:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.583989:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787032095.584017:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857010816 00000100:00100000:3.0:1787032095.584022:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857010816 00000100:00100000:3.0:1787032095.584061:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787032095.584097:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857010816:12345-0@lo:501: 00000100:00100000:3.0:1787032095.585404:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857010816:12345-0@lo:501: Request processed in 1304us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.585414:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787032095.588416:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010816:0@lo:501: 00000100:00100000:1.0:1787032095.588480:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010944:0@lo:503: 00000100:00100000:1.0:1787032095.588555:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032095.588588:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cba480 going to sleep for 11 seconds 00000100:00100000:3.0:1787032095.589247:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857010944 00000100:00100000:3.0:1787032095.589256:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857010944 00000100:00100000:3.0:1787032095.589309:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787032095.589319:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857010944:12345-0@lo:503: 00000100:00100000:3.0:1787032095.589691:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857010944:12345-0@lo:503: Request processed in 373us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.589700:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787032095.589753:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857010944:0@lo:503: 00000040:00080000:3.0:1787032095.590013:0:7482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787032095.590117:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011072:0@lo:502: 00000100:00100000:3.0:1787032095.590151:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.590179:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032095.590577:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857011072 00000100:00100000:1.0:1787032095.590582:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857011072 00000100:00100000:1.0:1787032095.590610:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787032095.590617:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857011072:12345-0@lo:502: 00000100:00100000:1.0:1787032095.590787:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857011072:12345-0@lo:502: Request processed in 170us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032095.590794:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787032095.591502:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011072:0@lo:502: 00000040:00080000:3.0:1787032095.591783:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787032095.591839:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787032095.591868:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011200:0@lo:502: 00000100:00100000:3.0:1787032095.591915:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.591947:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032095.591966:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857011200 00000100:00100000:3.0:1787032095.591970:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857011200 00000100:00100000:3.0:1787032095.592009:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787032095.592016:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857011200:12345-0@lo:502: 00000100:00100000:3.0:1787032095.595778:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857011200:12345-0@lo:502: Request processed in 3752us (3853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.595794:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787032095.596031:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011200:0@lo:502: 00000040:00080000:2.0:1787032095.596380:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787032095.596395:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787032095.599807:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787032095.599823:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032095.599826:0:7495:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787032095.599834:0:7495:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdc4c91800 00000020:00000080:2.0:1787032095.599836:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787032095.599857:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787032095.599860:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032095.599861:0:7495:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787032095.599865:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787032095.600018:0:7482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787032095.600053:0:7482:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787032095.600487:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.600518:0:7482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032095.600568:0:7482:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787032095.600571:0:7482:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cdc4c91800 10000000:01000000:3.0:1787032095.600575:0:7482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cdc4c91800 10000000:01000000:3.0:1787032095.600579:0:7482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787032095.600584:0:7482:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cdc4c91800 from 1 10000000:01000000:3.0:1787032095.600587:0:7482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787032095.600633:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.600641:0:7482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.600653:0:7482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032095.600677:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011328:0@lo:101: 00000100:00100000:3.0:1787032095.600744:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.600786:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032095.601781:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857011328 00000100:00100000:1.0:1787032095.601792:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857011328 00000100:00100000:1.0:1787032095.601852:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787032095.601862:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857011328:12345-0@lo:101: 00010000:00010000:1.0:1787032095.601886:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032095.601902:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9766 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.601928:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.601938:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032095.601947:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774800, rc 0) 00000100:00100000:1.0:1787032095.602003:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011328:12345-0@lo:101: Request processed in 142us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032095.602009:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787032095.602127:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011328:0@lo:101: 00010000:00010000:3.0:1787032095.602142:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032095.602151:0:7482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032095.602270:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011456:0@lo:501: 00000100:00100000:3.0:1787032095.602303:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032095.602327:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032095.602591:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857011456 00000100:00100000:1.0:1787032095.602596:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857011456 00000100:00100000:1.0:1787032095.602636:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787032095.602644:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011456:12345-0@lo:501: 00000100:00100000:1.0:1787032095.602868:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011456:12345-0@lo:501: Request processed in 224us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032095.602875:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787032095.604024:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011456:0@lo:501: 00000100:00100000:0.0:1787032095.604107:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011584:0@lo:503: 00000100:00100000:0.0:1787032095.604181:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.604332:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc61539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032095.604457:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857011584 00000100:00100000:1.0:1787032095.604463:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857011584 00000100:00100000:1.0:1787032095.604495:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787032095.604502:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011584:12345-0@lo:503: 00000100:00100000:1.0:1787032095.604689:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011584:12345-0@lo:503: Request processed in 186us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032095.604695:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787032095.604746:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011584:0@lo:503: 00000040:00080000:1.0:1787032095.605011:0:7482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787032095.605201:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011712:0@lo:502: 00000100:00100000:1.0:1787032095.605310:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032095.605334:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc352c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032095.605349:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857011712 00000100:00100000:1.0:1787032095.605353:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857011712 00000100:00100000:1.0:1787032095.605371:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787032095.605377:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011712:12345-0@lo:502: 00000100:00100000:1.0:1787032095.605553:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011712:12345-0@lo:502: Request processed in 175us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032095.605559:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787032095.605601:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011712:0@lo:502: 00000040:00080000:1.0:1787032095.605859:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787032095.605906:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787032095.605942:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787032095.605992:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787032095.606028:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787032095.609500:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787032095.609589:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787032095.609639:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787032095.609691:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787032095.609728:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787032095.609761:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787032095.609805:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787032095.609838:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787032095.609871:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787032095.609917:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787032095.609952:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787032095.610006:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787032095.610056:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787032095.614520:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787032095.614570:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787032095.614658:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787032095.614728:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787032095.614760:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787032095.614807:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787032095.614842:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787032095.614877:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787032095.614923:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787032095.614957:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787032095.614990:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787032095.615046:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787032095.616647:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787032095.616700:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787032095.616737:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787032095.616796:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787032095.616832:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787032095.616883:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787032095.616920:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787032095.616969:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011840:0@lo:502: 00000100:00100000:1.0:1787032095.617049:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032095.617155:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded0ba9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032095.618419:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857011840 00000100:00100000:3.0:1787032095.618430:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857011840 00000100:00100000:3.0:1787032095.618484:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787032095.618494:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011840:12345-0@lo:502: 00000100:00100000:3.0:1787032095.618766:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857011840:12345-0@lo:502: Request processed in 274us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032095.618774:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787032095.618895:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857011840:0@lo:502: 00000040:00080000:0.0:1787032095.619000:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787032095.619015:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787032095.622610:0:7496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787032095.622636:0:7496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99cdff7c3380) 00000020:00000080:1.0:1787032095.622658:0:7496:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787032095.622826:0:7496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdc4c91800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787032095.622831:0:7496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cdc4c91800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787032095.622833:0:7496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdc4c91800 3 00010000:00080000:1.0:1787032095.622861:0:7496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cdfacba000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.148@tcp at head 00010000:00010000:1.0:1787032095.630574:0:7496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787032095.630700:0:7496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787032095.630740:0:7496:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787032095.630752:0:7496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd047797ef1e977b 00000100:00080000:1.0:1787032095.630762:0:7496:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787032095.630768:0:7496:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cdfacba000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:1.0:1787032095.630802:0:7496:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdf4874e00 x1873838857011968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787032095.630831:0:7496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787032095.632315:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032095.632334:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857012096:0@lo:400: 00000100:00100000:2.0:1787032095.632402:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.632434:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857012352:0@lo:400: 00000100:00100000:2.0:1787032095.632456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.632472:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787032095.632483:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857012224:0@lo:400: 00000100:00100000:2.0:1787032095.632501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.632526:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857012096 00000100:00100000:2.0:1787032095.632531:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857012096 00000100:00100000:2.0:1787032095.632561:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857012224 00000100:00100000:2.0:1787032095.632564:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857012224 00000100:00100000:2.0:1787032095.632578:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787032095.632585:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857012096:12345-0@lo:400: 00000100:00100000:2.0:1787032095.632643:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857012096:12345-0@lo:400: Request processed in 57us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.632650:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787032095.632666:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787032095.632672:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857012224:12345-0@lo:400: 00000100:00100000:2.0:1787032095.632703:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857012224:12345-0@lo:400: Request processed in 31us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.632709:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787032095.632726:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857012352 00000100:00100000:2.0:1787032095.632730:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857012352 00000100:00100000:2.0:1787032095.632753:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032095.632758:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857012352:12345-0@lo:400: 00000100:00100000:2.0:1787032095.632786:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857012352:12345-0@lo:400: Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.632792:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787032095.632829:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc8d59500 x1873838857012096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032095.632843:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857012096:0@lo:400: 00010000:00080000:2.0:1787032095.632868:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc8d5bb80 x1873838857012224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032095.632884:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857012224:0@lo:400: 00010000:00080000:2.0:1787032095.632895:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdc8d59c00 x1873838857012352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032095.632903:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857012352:0@lo:400: 00000100:00100000:3.0:1787032095.633306:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1873838857011968:0@lo:38: 00000100:00100000:3.0:1787032095.634045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787032095.635435:0:7496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1787032095.635589:0:7498:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff99cdf4877480 x1873838857012480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032095.635602:0:7498:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdca079600 going to sleep for 0 seconds 00000020:01000000:0.0:1787032095.635692:0:7482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787032095.635720:0:7482:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787032095.635737:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032095.635748:0:7482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787032095.635794:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787032095.635797:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787032095.635798:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032095.635799:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032095.635801:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032095.635802:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032095.635803:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787032095.635805:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787032095.635806:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787032095.635808:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032095.635809:0:7482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787032095.635814:0:7482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787032095.635816:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787032095.635818:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787032095.635819:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032095.635820:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032095.635821:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032095.635822:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032095.635823:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787032095.635824:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787032095.635825:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787032095.635827:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032095.635834:0:7482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787032095.635850:0:7482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787032095.635861:0:7482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca070700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857012608:0@lo:253: 00000100:00100000:0.0:1787032095.635926:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032095.635959:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857012608 00000100:00100000:0.0:1787032095.635966:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857012608 00000100:00100000:0.0:1787032095.636015:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787032095.636024:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:7482:x1873838857012608:12345-0@lo:253: 20000000:01000000:0.0:1787032095.636053:0:5792:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787032095.636775:0:5792:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787032095.638499:0:7482:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc6153300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032095.642875:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857011968 00000100:00100000:2.0:1787032095.642892:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857011968 00000100:00100000:2.0:1787032095.642939:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032095.642947:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1873838857011968:12345-0@lo:38: 00010000:00080000:2.0:1787032095.642977:0:5799:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787032095.643017:0:5799:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd047797ef1e9782 00000004:00100000:2.0:1787032095.643037:0:5799:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787032095.643097:0:5799:0:(import.c:65:import_set_state_nolock()) ffff99cdff7cb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787032095.643190:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873838857011968:12345-0@lo:38: Request processed in 242us (9146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.643197:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787032095.645144:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdf4874e00 x1873838857011968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787032105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032095.645159:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787032095.645169:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787032095.645178:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787032095.645185:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787032095.645189:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdfacba000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787032095.645196:0:3301:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ef379ef8): req@ffff99cdf4877480 x1873838857012480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032095.645245:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1873838857011968:0@lo:38: 00000100:00100000:2.0:1787032095.645349:0:7498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.645385:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857012480 00000100:00100000:2.0:1787032095.645391:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857012480 00000100:00100000:2.0:1787032095.645433:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787032095.645440:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7498:x1873838857012480:12345-0@lo:901: 00000100:00100000:2.0:1787032095.645796:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7498:x1873838857012480:12345-0@lo:901: Request processed in 355us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.645804:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787032095.645822:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787032095.645843:0:7498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdf4877480 x1873838857012480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787032111 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032095.645854:0:7498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7498:1873838857012480:0@lo:901: 20000000:01000000:1.0:1787032095.764005:0:5792:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787032095.764026:0:5792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787032095.764132:0:5813:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787032095.764138:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787032095.764161:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764179:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764188:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764245:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764260:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 14 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032095.764288:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1873838857012736:0@lo:104: 00000100:00100000:2.0:1787032095.764364:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.764420:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b1a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787032095.764441:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857012736 00000100:00100000:2.0:1787032095.764448:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857012736 00000100:00100000:2.0:1787032095.764495:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787032095.764504:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0402f217-6678-4505-97bf-ca0cb32c7313+3:5813:x1873838857012736:12345-0@lo:104: 00010000:00010000:2.0:1787032095.764517:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764565:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787032095.764571:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0402f217-6678-4505-97bf-ca0cb32c7313+3:5813:x1873838857012736:12345-0@lo:104: Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.764578:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787032095.764599:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032095.764605:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764613:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:2.0:1787032095.764646:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764656:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787032095.764662:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032095.764678:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787032095.764704:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764709:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787032095.764725:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764732:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1536000/0xcd047797ef1e96c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96cc expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764751:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032095.764752:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032095.764754:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032095.764770:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857012864:0@lo:103: 00000100:00100000:2.0:1787032095.764799:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032095.764828:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857012864 00000100:00100000:2.0:1787032095.764832:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857012864 00010000:00010000:2.0:1787032095.764848:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 15 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032095.764869:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787032095.764876:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+15:3302:x1873838857012864:12345-0@lo:103: 00010000:00010000:2.0:1787032095.764885:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032095.764890:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 15 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764899:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 15 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764920:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764928:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787032095.764940:0:5782:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002839530s 00010000:00010000:2.0:1787032095.764945:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764951:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764958:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764964:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764968:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032095.764972:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764978:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764985:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.764993:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032095.765020:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+15:3302:x1873838857012864:12345-0@lo:103: Request processed in 145us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032095.765032:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787032095.765141:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857012864:0@lo:103: 00010000:00010000:2.0:1787032095.765166:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1536800/0xcd047797ef1e96cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e96c5 expref: 14 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032095.765175:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5813:1873838857012736:0@lo:104: 00010000:00010000:2.0:1787032095.765186:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.765194:0:5813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.765200:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032095.765206:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e9789 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032095.799035:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:7482:x1873838857012608:12345-0@lo:253: Request processed in 163002us (163099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032095.799050:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787032095.800192:0:7482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca070700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0402f217-6678-4505-97bf-ca0cb32c7313:7482:1873838857012608:0@lo:253: 10000000:01000000:2.0:1787032095.800222:0:7482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787032095.800226:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787032095.800228:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787032095.800230:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787032095.800231:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787032095.800232:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787032095.800234:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787032095.800235:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787032095.800237:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787032095.800239:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787032095.800240:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787032095.800242:0:7482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787032095.800272:0:7482:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787032095.811923:0:7482:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032095.814501:0:7482:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787032095.814883:0:7482:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032095.822580:0:7482:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787032095.823108:0:7482:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787032095.831498:0:7482:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787032095.833158:0:7482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787032096.129401:0:7482:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787032096.129412:0:7482:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787032096.130473:0:7482:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787032096.130547:0:7482:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787032096.130564:0:7482:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787032096.130598:0:7482:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787032096.385873:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032097.409292:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032098.440979:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032099.458426:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032100.097416:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857012992:0@lo:13: 00000100:00100000:2.0:1787032100.097509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032100.099637:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857012992 00000100:00100000:1.0:1787032100.099654:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857012992 00000100:00100000:1.0:1787032100.099750:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787032100.099762:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857012992:12345-0@lo:13: 00002000:00000024:1.0:1787032100.099805:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032100.099890:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857012992:12345-0@lo:13: Request processed in 131us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032100.099898:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787032100.101364:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787032100.101418:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4877100 x1873838857012992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032100.101442:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857012992:0@lo:13: 00010000:00010000:0.0:1787032100.482052:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032101.121326:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857013376:0@lo:400: 00000100:00100000:2.0:1787032101.121397:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032101.121450:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032101.121457:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857013504:0@lo:400: 00000100:00100000:2.0:1787032101.121482:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032101.121530:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857013376 00000100:00100000:2.0:1787032101.121537:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857013376 00000100:00100000:1.0:1787032101.121563:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857013248:0@lo:400: 00000100:00100000:2.0:1787032101.121587:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787032101.121592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032101.121601:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857013376:12345-0@lo:400: 00000100:00100000:1.0:1787032101.121619:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787032101.121624:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857013120:0@lo:400: 00000100:00100000:1.0:1787032101.121650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032101.123105:0:5799:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787032101.123118:0:5799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1787032101.123135:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032101.123148:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857013504 00000100:00100000:3.0:1787032101.123155:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857013504 00000100:00100000:3.0:1787032101.123196:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787032101.123205:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857013504:12345-0@lo:400: 00000100:00100000:2.0:1787032101.127208:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857013376:12345-0@lo:400: Request processed in 5596us (5799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032101.127224:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787032101.127262:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857013248 00000100:00100000:2.0:1787032101.127271:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857013248 00000100:00100000:2.0:1787032101.127308:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787032101.127315:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857013248:12345-0@lo:400: 00000100:00100000:2.0:1787032101.127384:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857013248:12345-0@lo:400: Request processed in 69us (5790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032101.127390:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787032101.127440:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d58700 x1873838857013376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032101.127454:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857013376:0@lo:400: 00000100:00100000:1.0:1787032101.128270:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857013632:0@lo:400: 00000100:00100000:1.0:1787032101.128312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787032101.128348:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d5aa00 x1873838857013248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032101.128359:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857013248:0@lo:400: 00000100:00100000:1.0:1787032101.128384:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857013632 00000100:00100000:1.0:1787032101.128388:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857013632 00000100:00100000:1.0:1787032101.128424:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032101.128501:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857013632:12345-0@lo:400: 00000100:00100000:1.0:1787032101.128550:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857013632:12345-0@lo:400: Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032101.128557:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032101.128643:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857013120 00000100:00100000:1.0:1787032101.128648:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857013120 00000100:00100000:1.0:1787032101.128672:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787032101.128677:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:3305:x1873838857013120:12345-0@lo:400: 00000100:00100000:1.0:1787032101.128709:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:3305:x1873838857013120:12345-0@lo:400: Request processed in 32us (7058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032101.128715:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787032101.128735:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032101.128750:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857013120:0@lo:400: 00010000:00080000:1.0:1787032101.128759:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfb136300 x1873838857013632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032101.128780:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857013632:0@lo:400: 00000100:00100000:3.0:1787032101.139370:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857013504:12345-0@lo:400: Request processed in 16155us (17876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032101.139386:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787032101.139549:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d59f80 x1873838857013504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032101.139564:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857013504:0@lo:400: 00010000:00010000:2.0:1787032101.505295:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032102.534459:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787032102.736972:0:7840:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787032103.554220:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032104.577312:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787032104.705594:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787032104.705601:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cdefa84800 from 30 10000000:01000000:0.0:1787032104.705607:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787032104.705659:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.705672:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.705683:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032104.705709:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857013760:0@lo:101: 00000100:00100000:0.0:1787032104.705781:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.705843:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787032104.706552:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857013760 00000100:00100000:2.0:1787032104.706562:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857013760 00000100:00100000:2.0:1787032104.706621:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787032104.706630:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857013760:12345-0@lo:101: 00010000:00010000:2.0:1787032104.706644:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032104.706661:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9790 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032104.706705:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032104.706717:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032104.706728:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6000, rc 0) 00000100:00100000:2.0:1787032104.706795:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857013760:12345-0@lo:101: Request processed in 166us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.706803:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787032104.707113:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857013760:0@lo:101: 00010000:00010000:0.0:1787032104.707140:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.707150:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032104.707210:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857013888:0@lo:501: 00000100:00100000:0.0:1787032104.707240:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.707279:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787032104.707429:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857013888 00000100:00100000:1.0:1787032104.707434:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857013888 00000100:00100000:1.0:1787032104.707475:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787032104.707483:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857013888:12345-0@lo:501: 00000100:00100000:1.0:1787032104.707860:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857013888:12345-0@lo:501: Request processed in 376us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.707867:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787032104.708060:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857013888:0@lo:501: 00000100:00100000:0.0:1787032104.708116:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857014016:0@lo:503: 00000100:00100000:0.0:1787032104.708156:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.708185:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787032104.708242:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857014016 00000100:00100000:2.0:1787032104.708247:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857014016 00000100:00100000:2.0:1787032104.708283:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787032104.708290:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857014016:12345-0@lo:503: 00000100:00100000:2.0:1787032104.708609:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857014016:12345-0@lo:503: Request processed in 318us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.708616:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787032104.708730:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857014016:0@lo:503: 00000100:00100000:1.0:1787032104.712944:0:7945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7945:1873838857014144:0@lo:502: 00000100:00100000:1.0:1787032104.713039:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.713124:0:7945:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb7919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032104.713247:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857014144 00000100:00100000:2.0:1787032104.713255:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857014144 00000100:00100000:2.0:1787032104.713312:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787032104.713322:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:7945:x1873838857014144:12345-0@lo:502: 00000100:00100000:2.0:1787032104.713670:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:7945:x1873838857014144:12345-0@lo:502: Request processed in 349us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.713679:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787032104.713841:0:7945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7945:1873838857014144:0@lo:502: 00000100:00100000:1.0:1787032104.713907:0:7945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7945:1873838857014272:0@lo:502: 00000100:00100000:1.0:1787032104.713943:0:7945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.713969:0:7945:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787032104.716660:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857014272 00000100:00100000:2.0:1787032104.716673:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857014272 00000100:00100000:2.0:1787032104.716739:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787032104.716761:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+14:7945:x1873838857014272:12345-0@lo:502: 00000100:00100000:2.0:1787032104.717049:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+14:7945:x1873838857014272:12345-0@lo:502: Request processed in 289us (3104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.717057:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787032104.717401:0:7945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7945:1873838857014272:0@lo:502: 00000040:00080000:1.0:1787032104.717441:0:7945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787032104.717616:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787032104.717642:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787032104.717653:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.717664:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032104.717673:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787032104.717675:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787032104.717678:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787032104.717710:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.717727:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.717737:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032104.717755:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857014400:0@lo:101: 00000100:00100000:0.0:1787032104.717793:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.717831:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787032104.718317:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857014400 00000100:00100000:1.0:1787032104.718324:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857014400 00000100:00100000:1.0:1787032104.718366:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787032104.718375:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857014400:12345-0@lo:101: 00010000:00010000:1.0:1787032104.718386:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032104.718400:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e979e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.718434:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e979e expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.718445:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e979e expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.718462:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775800, rc 0) 00000100:00100000:1.0:1787032104.718510:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857014400:12345-0@lo:101: Request processed in 136us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.718516:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787032104.718621:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857014400:0@lo:101: 00010000:00010000:0.0:1787032104.718635:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.718643:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032104.718689:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857014528:0@lo:501: 00000100:00100000:0.0:1787032104.718714:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.718741:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.718787:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857014528 00000100:00100000:3.0:1787032104.718791:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857014528 00000100:00100000:3.0:1787032104.718824:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787032104.718832:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857014528:12345-0@lo:501: 00000100:00100000:3.0:1787032104.719101:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857014528:12345-0@lo:501: Request processed in 270us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.719111:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787032104.719243:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857014528:0@lo:501: 00000100:00100000:0.0:1787032104.719273:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857014656:0@lo:503: 00000100:00100000:0.0:1787032104.719313:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.719341:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787032104.719412:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857014656 00000100:00100000:1.0:1787032104.719416:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857014656 00000100:00100000:1.0:1787032104.719448:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787032104.719464:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857014656:12345-0@lo:503: 00000100:00100000:1.0:1787032104.719761:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857014656:12345-0@lo:503: Request processed in 306us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.719768:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787032104.719926:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857014656:0@lo:503: 00000100:00100000:0.0:1787032104.721147:0:7946:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7946:1873838857014784:0@lo:502: 00000100:00100000:0.0:1787032104.721216:0:7946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.721245:0:7946:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032104.721327:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857014784 00000100:00100000:1.0:1787032104.721332:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857014784 00000100:00100000:1.0:1787032104.721366:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787032104.721373:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+15:7946:x1873838857014784:12345-0@lo:502: 00000100:00100000:1.0:1787032104.721772:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+15:7946:x1873838857014784:12345-0@lo:502: Request processed in 397us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.721780:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787032104.724044:0:7946:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7946:1873838857014784:0@lo:502: 00000020:01000000:2.0:1787032104.724110:0:7946:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787032104.724122:0:7946:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032104.724124:0:7946:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787032104.724130:0:7946:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787032104.724132:0:7946:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787032104.724167:0:7946:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7946:1873838857014912:0@lo:502: 00000100:00100000:2.0:1787032104.724241:0:7946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032104.724278:0:7946:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.724384:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857014912 00000100:00100000:3.0:1787032104.724391:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857014912 00000100:00100000:3.0:1787032104.724443:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787032104.724452:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:7946:x1873838857014912:12345-0@lo:502: 00000100:00100000:3.0:1787032104.724682:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:7946:x1873838857014912:12345-0@lo:502: Request processed in 231us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.724691:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787032104.724936:0:7946:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7946:1873838857014912:0@lo:502: 00000020:01000000:2.0:1787032104.724959:0:7946:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787032104.724964:0:7946:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032104.724966:0:7946:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787032104.724970:0:7946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787032104.725230:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787032104.725250:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787032104.725260:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.725277:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032104.725287:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787032104.725290:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cde4b73800 from 30 10000000:01000000:1.0:1787032104.725293:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787032104.725323:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.725331:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.725340:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032104.725357:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015040:0@lo:101: 00000100:00100000:1.0:1787032104.725390:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.725429:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787032104.733663:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857015040 00000100:00100000:2.0:1787032104.733678:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857015040 00000100:00100000:2.0:1787032104.733749:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787032104.733759:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857015040:12345-0@lo:101: 00010000:00010000:2.0:1787032104.733776:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032104.733796:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e97ac expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032104.733824:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032104.733853:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032104.733862:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032104.733958:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857015040:12345-0@lo:101: Request processed in 200us (8567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.733964:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787032104.734054:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015040:0@lo:101: 00010000:00010000:1.0:1787032104.734101:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.734111:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032104.734177:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015168:0@lo:501: 00000100:00100000:1.0:1787032104.734212:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.734255:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.734367:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857015168 00000100:00100000:3.0:1787032104.734372:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857015168 00000100:00100000:3.0:1787032104.734408:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787032104.734415:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857015168:12345-0@lo:501: 00000100:00100000:3.0:1787032104.734663:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857015168:12345-0@lo:501: Request processed in 247us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.734669:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787032104.734738:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015168:0@lo:501: 00000100:00100000:1.0:1787032104.734767:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015296:0@lo:503: 00000100:00100000:1.0:1787032104.734804:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.734831:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.734874:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857015296 00000100:00100000:3.0:1787032104.734878:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857015296 00000100:00100000:3.0:1787032104.734916:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787032104.734923:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857015296:12345-0@lo:503: 00000100:00100000:3.0:1787032104.735088:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857015296:12345-0@lo:503: Request processed in 142us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.735105:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787032104.735241:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015296:0@lo:503: 00000100:00100000:2.0:1787032104.736320:0:7947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7947:1873838857015424:0@lo:502: 00000100:00100000:2.0:1787032104.736379:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032104.736415:0:7947:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.736630:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857015424 00000100:00100000:3.0:1787032104.736637:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857015424 00000100:00100000:3.0:1787032104.736679:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787032104.736687:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:7947:x1873838857015424:12345-0@lo:502: 00000100:00100000:3.0:1787032104.737034:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:7947:x1873838857015424:12345-0@lo:502: Request processed in 347us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.737042:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787032104.740024:0:7947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7947:1873838857015424:0@lo:502: 00000100:00100000:2.0:1787032104.740248:0:7947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7947:1873838857015552:0@lo:502: 00000100:00100000:2.0:1787032104.740325:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032104.740409:0:7947:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787032104.741950:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857015552 00000100:00100000:1.0:1787032104.741962:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857015552 00000100:00100000:1.0:1787032104.742018:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787032104.742026:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:7947:x1873838857015552:12345-0@lo:502: 00000100:00100000:1.0:1787032104.742311:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:7947:x1873838857015552:12345-0@lo:502: Request processed in 284us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.742319:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787032104.742552:0:7947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7947:1873838857015552:0@lo:502: 00000040:00080000:3.0:1787032104.742585:0:7947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787032104.742798:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787032104.742816:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787032104.742825:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.742836:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032104.742846:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787032104.742848:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cde4b73800 from 5 10000000:01000000:1.0:1787032104.742851:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787032104.742881:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.742888:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032104.742961:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032104.742979:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015680:0@lo:101: 00000100:00100000:1.0:1787032104.743013:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.743044:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.743280:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857015680 00000100:00100000:3.0:1787032104.743286:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857015680 00000100:00100000:3.0:1787032104.743322:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787032104.743330:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857015680:12345-0@lo:101: 00010000:00010000:3.0:1787032104.743339:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032104.743353:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ce02047000/0xcd047797ef1e97c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e97ba expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032104.743375:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ce02047000/0xcd047797ef1e97c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e97ba expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032104.743386:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ce02047000/0xcd047797ef1e97c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e97ba expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032104.743395:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ce02047000, rc 0) 00000100:00100000:3.0:1787032104.743436:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857015680:12345-0@lo:101: Request processed in 107us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.743451:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787032104.743530:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015680:0@lo:101: 00010000:00010000:2.0:1787032104.743543:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032104.743551:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032104.743593:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015808:0@lo:256: 00000100:00100000:2.0:1787032104.743622:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032104.743648:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.744053:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857015808 00000100:00100000:3.0:1787032104.744058:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857015808 00000100:00100000:3.0:1787032104.744114:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787032104.744121:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857015808:12345-0@lo:256: 20000000:01000000:3.0:1787032104.744135:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787032104.744154:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787032104.744157:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787032104.744235:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857015808:12345-0@lo:256: Request processed in 114us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.744242:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787032104.744320:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015808:0@lo:256: 10000000:01000000:0.0:1787032104.744366:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787032104.744373:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.744380:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032104.744388:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787032104.744390:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787032104.744392:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787032104.744411:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.744417:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.744425:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032104.744438:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015936:0@lo:101: 00000100:00100000:0.0:1787032104.744475:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.744584:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.744623:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857015936 00000100:00100000:3.0:1787032104.744627:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857015936 00000100:00100000:3.0:1787032104.744643:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787032104.744648:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857015936:12345-0@lo:101: 00010000:00010000:3.0:1787032104.744655:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032104.744664:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e97c8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032104.744677:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032104.744685:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032104.744692:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ce02046000, rc 0) 00000100:00100000:3.0:1787032104.744724:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857015936:12345-0@lo:101: Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.744737:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787032104.744860:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857015936:0@lo:101: 00010000:00010000:0.0:1787032104.744870:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.744889:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032104.744949:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857016064:0@lo:501: 00000100:00100000:0.0:1787032104.744972:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.744996:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.745111:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857016064 00000100:00100000:3.0:1787032104.745115:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857016064 00000100:00100000:3.0:1787032104.745139:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787032104.745144:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857016064:12345-0@lo:501: 00000100:00100000:3.0:1787032104.745375:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857016064:12345-0@lo:501: Request processed in 230us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.745382:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787032104.745654:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857016064:0@lo:501: 00000100:00100000:0.0:1787032104.745681:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857016192:0@lo:503: 00000100:00100000:0.0:1787032104.745714:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.745738:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032104.745784:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857016192 00000100:00100000:1.0:1787032104.745788:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857016192 00000100:00100000:1.0:1787032104.745817:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787032104.745823:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857016192:12345-0@lo:503: 00000100:00100000:1.0:1787032104.746142:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857016192:12345-0@lo:503: Request processed in 318us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.746149:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787032104.746290:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857016192:0@lo:503: 00000100:00100000:3.0:1787032104.746880:0:7948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7948:1873838857016320:0@lo:502: 00000100:00100000:3.0:1787032104.746988:0:7948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032104.747019:0:7948:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc6153900 going to sleep for 11 seconds 00000100:00100000:2.0:1787032104.747063:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857016320 00000100:00100000:2.0:1787032104.747133:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857016320 00000100:00100000:2.0:1787032104.747166:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787032104.747173:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:7948:x1873838857016320:12345-0@lo:502: 00000100:00100000:2.0:1787032104.747436:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:7948:x1873838857016320:12345-0@lo:502: Request processed in 262us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.747443:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787032104.747686:0:7948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7948:1873838857016320:0@lo:502: 00000020:01000000:3.0:1787032104.747711:0:7948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787032104.747718:0:7948:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787032104.747724:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032104.747727:0:7948:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787032104.747732:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787032104.747735:0:7948:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.148@tcp to nid 0x20000c0a8c994 (192.168.201.148@tcp) 00000020:01000000:3.0:1787032104.747758:0:7948:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787032104.747761:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787032104.747775:0:7948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cdc8183380) 00000020:00000080:3.0:1787032104.747798:0:7948:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787032104.747805:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787032104.747883:0:7948:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787032104.747888:0:7948:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787032104.748020:0:7948:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1e97dd 00010000:00080000:3.0:1787032104.748050:0:7948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cdc7780000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.148@tcp at head 00010000:00010000:3.0:1787032104.749333:0:7948:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787032104.750874:0:7948:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787032104.752871:0:7948:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787032104.753543:0:7948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787032104.753784:0:7948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787032104.753838:0:7948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787032104.753904:0:7948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787032104.757726:0:7949:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787032104.757734:0:7949:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787032104.759639:0:7948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787032104.759655:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787032104.759690:0:7948:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787032104.759714:0:7948:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1e97e4 00000100:00080000:3.0:1787032104.759726:0:7948:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787032104.759731:0:7948:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cdc7780000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:3.0:1787032104.759764:0:7948:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ce011a2a00 x1873838857016448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787032104.759828:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857016448:0@lo:8: 00000100:00100000:2.0:1787032104.759913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.760013:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857016448 00000100:00100000:0.0:1787032104.760022:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857016448 00000100:00100000:0.0:1787032104.760086:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787032104.760094:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3301:x1873838857016448:12345-0@lo:8: 00010000:00080000:0.0:1787032104.760118:0:6895:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:0.0:1787032104.760142:0:6895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1e97eb 00002000:00100000:0.0:1787032104.760155:0:6895:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cdefc26800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113701 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787032104.760159:0:6895:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787032104.760163:0:6895:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787032104.760284:0:6895:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787032104.760422:0:6895:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787032104.760448:0:6895:0:(import.c:65:import_set_state_nolock()) ffff99cdefc20800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787032104.761663:0:7948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787032104.761751:0:7948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032104.761757:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032104.761759:0:7948:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787032104.761763:0:7948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032104.761767:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032104.761768:0:7948:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787032104.761771:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787032104.761772:0:7948:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787032104.761812:0:7948:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7948:1873838857016576:0@lo:502: 00000100:00100000:3.0:1787032104.761882:0:7948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032104.761935:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857016576 00000100:00100000:3.0:1787032104.761942:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857016576 00000100:00100000:3.0:1787032104.761990:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787032104.761997:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:7948:x1873838857016576:12345-0@lo:502: 00000100:00100000:3.0:1787032104.762254:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:7948:x1873838857016576:12345-0@lo:502: Request processed in 256us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.762262:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787032104.762311:0:7948:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfba4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.762333:0:7948:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:7948:1873838857016576:0@lo:502: 00000020:01000000:3.0:1787032104.762359:0:7948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032104.762364:0:7948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032104.762366:0:7948:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787032104.762370:0:7948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1787032104.762851:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857016704:0@lo:400: 00000100:00100000:3.0:1787032104.762885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032104.763009:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787032104.763016:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857017088:0@lo:400: 00000100:00100000:3.0:1787032104.763038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.769261:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1873838857016448:12345-0@lo:8: Request processed in 9154us (9336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032104.769294:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787032104.769416:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857016832:0@lo:400: 00000100:00100000:3.0:1787032104.769491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787032104.769713:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ce011a2a00 x1873838857016448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787032114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032104.769724:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787032104.769734:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787032104.769742:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787032104.769747:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787032104.769750:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc7780000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787032104.769766:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787032104.769771:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857016448:0@lo:8: 00000100:00100000:2.0:1787032104.769810:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857016960:0@lo:400: 00000100:00100000:2.0:1787032104.769841:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032104.769874:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857016960 00000100:00100000:2.0:1787032104.769879:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857016960 00000100:00100000:1.0:1787032104.769996:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857016704 00000100:00100000:1.0:1787032104.770001:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857016704 00000100:00100000:1.0:1787032104.770041:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857017088 00000100:00100000:1.0:1787032104.770045:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857017088 00000100:00100000:2.0:1787032104.770112:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787032104.770120:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857016960:12345-0@lo:400: 00000100:00100000:2.0:1787032104.770168:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857016960:12345-0@lo:400: Request processed in 49us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.770174:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787032104.770203:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787032104.770209:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857016704:12345-0@lo:400: 00000100:00100000:2.0:1787032104.770243:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857016704:12345-0@lo:400: Request processed in 34us (7358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.770250:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:0.0:1787032104.776855:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787032104.776904:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787032104.776917:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.776929:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032104.776940:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787032104.776943:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99cdc7654d40 from 1 10000000:01000000:0.0:1787032104.776946:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787032104.776988:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.776995:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.777006:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032104.777033:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857017216:0@lo:101: 00000100:00100000:0.0:1787032104.777115:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.777162:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032104.777185:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857017216 00000100:00100000:0.0:1787032104.777193:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857017216 00000100:00100000:0.0:1787032104.777242:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787032104.777251:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857017216:12345-0@lo:101: 00010000:00010000:0.0:1787032104.777265:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032104.777294:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e97f2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.777318:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.777328:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.777336:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030200, rc 0) 00000100:00100000:0.0:1787032104.777374:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857017216:12345-0@lo:101: Request processed in 124us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032104.777381:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787032104.777432:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857017216:0@lo:101: 00010000:00010000:0.0:1787032104.777446:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.777467:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032104.778705:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857017344:0@lo:501: 00000100:00100000:0.0:1787032104.778752:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.778777:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032104.778803:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857017344 00000100:00100000:0.0:1787032104.778809:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857017344 00000100:00100000:0.0:1787032104.778840:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787032104.778848:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857017344:12345-0@lo:501: 00000100:00100000:0.0:1787032104.779162:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857017344:12345-0@lo:501: Request processed in 313us (408us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032104.779178:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787032104.779219:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857017344:0@lo:501: 10000000:01000000:0.0:1787032104.779247:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787032104.779256:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032104.779266:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032104.780079:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032104.780089:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857017088:12345-0@lo:400: 00000100:00100000:1.0:1787032104.780138:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857017088:12345-0@lo:400: Request processed in 51us (17099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.780144:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1787032104.781250:0:7949:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787032104.781360:0:7949:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 259627291106ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787032104.782134:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857016832 00000100:00100000:1.0:1787032104.782145:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857016832 00000100:00100000:1.0:1787032104.782203:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787032104.782212:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857016832:12345-0@lo:400: 00000100:00100000:1.0:1787032104.782292:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857016832:12345-0@lo:400: Request processed in 81us (12800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.782312:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787032104.782356:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4875c00 x1873838857016832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032104.782369:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857016832:0@lo:400: 00010000:00080000:0.0:1787032104.782658:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4876a00 x1873838857017088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032104.782671:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857017088:0@lo:400: 00010000:00080000:0.0:1787032104.782687:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4875500 x1873838857016704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032104.782694:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857016704:0@lo:400: 00010000:00080000:3.0:1787032104.787090:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4876300 x1873838857016960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032104.787110:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857016960:0@lo:400: 00000100:00080000:2.0:1787032104.787190:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787032104.787474:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787032104.852220:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787032104.852708:0:7950:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787032104.852739:0:7950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7950:1873838857017600:0@lo:7: 00000100:00100000:1.0:1787032104.852814:0:7950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.852882:0:7950:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787032104.852900:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857017600 00000100:00100000:3.0:1787032104.852909:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857017600 00000100:00100000:3.0:1787032104.852990:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787032104.853013:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7950:x1873838857017600:12345-0@lo:7: 00000100:00100000:2.0:1787032104.853016:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032104.853033:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857017472:0@lo:13: 00000100:00100000:2.0:1787032104.853088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.853164:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857017472 00000100:00100000:1.0:1787032104.853168:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857017472 00000100:00100000:1.0:1787032104.853202:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787032104.853209:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857017472:12345-0@lo:13: 00002000:00000024:1.0:1787032104.853235:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787032104.853288:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857017472:12345-0@lo:13: Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032104.853295:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787032104.853331:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4875c00 x1873838857017472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032104.853349:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857017472:0@lo:13: 00000100:00080000:1.0:1787032104.853372:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787032104.871821:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787032104.871831:0:6584:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787032104.871927:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7950:x1873838857017600:12345-0@lo:7: Request processed in 18912us (19108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032104.871937:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787032104.872219:0:7950:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4875880 x1873838857017600/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787032120 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032104.872235:0:7950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7950:1873838857017600:0@lo:7: 00000004:00080000:1.0:1787032104.872248:0:7950:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787032104.872299:0:7950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7950:1873838857017728:0@lo:5: 00000100:00100000:1.0:1787032104.872334:0:7950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.872393:0:7950:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787032104.872536:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857017728 00000100:00100000:0.0:1787032104.872543:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857017728 00000100:00100000:0.0:1787032104.872589:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032104.872598:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7950:x1873838857017728:12345-0@lo:5: 00002000:00080000:0.0:1787032104.872624:0:6895:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787032104.872628:0:6895:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787032104.872914:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:7950:x1873838857017728:12345-0@lo:5: Request processed in 316us (578us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787032104.872922:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787032104.872994:0:7950:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4875880 x1873838857017728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787032120 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032104.873005:0:7950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7950:1873838857017728:0@lo:5: 00000004:00080000:1.0:1787032104.873014:0:7950:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787032104.873039:0:7950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7950:1873838857017856:0@lo:700: 00000100:00100000:1.0:1787032104.873064:0:7950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032104.873109:0:7950:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787032104.873170:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857017856 00000100:00100000:0.0:1787032104.873182:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857017856 00000100:00100000:0.0:1787032104.873218:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032104.873225:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7950:x1873838857017856:12345-0@lo:700: 00000100:00100000:0.0:1787032104.873254:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6593:1873838857017984:0@lo:700: 00000100:00100000:0.0:1787032104.873282:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032104.873313:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc395c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787032104.873467:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857017984 00000100:00100000:2.0:1787032104.873471:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857017984 00000100:00100000:2.0:1787032104.873522:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787032104.873529:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6593:x1873838857017984:12345-0@lo:700: 40000000:02000000:2.0:1787032104.970295:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787032104.990491:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6593:x1873838857017984:12345-0@lo:700: Request processed in 116953us (117199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032104.990517:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787032104.992834:0:6593:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca071500 x1873838857017984/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787032120 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032104.992855:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6593:1873838857017984:0@lo:700: 40000000:02000000:0.0:1787032104.992871:0:6593:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787032105.137807:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787032105.137819:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787032105.138573:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7950:x1873838857017856:12345-0@lo:700: Request processed in 265341us (265501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032105.138585:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787032105.141041:0:7950:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4875500 x1873838857017856/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787032120 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032105.141055:0:7950:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787032105.141278:0:7950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7950:1873838857017856:0@lo:700: 00000004:02000040:0.0:1787032105.170834:0:7950:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787032105.176814:0:7950:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7950:1873838857018112:0@lo:5: 00000100:00100000:2.0:1787032105.176956:0:7950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032105.177056:0:7950:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787032105.177263:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857018112 00000100:00100000:0.0:1787032105.177271:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857018112 00000100:00100000:0.0:1787032105.177332:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787032105.177343:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7950:x1873838857018112:12345-0@lo:5: 00002000:00080000:2.0:1787032105.183729:0:6587:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787032105.183754:0:6587:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787032105.193403:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7950:x1873838857018112:12345-0@lo:5: Request processed in 16050us (16436us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787032105.193418:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787032105.195302:0:7950:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfb137800 x1873838857018112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787032121 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032105.195322:0:7950:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7950:1873838857018112:0@lo:5: 00000004:00080000:1.0:1787032105.195338:0:7950:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1787032105.217392:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787032105.218146:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857018240:0@lo:13: 00000100:00100000:2.0:1787032105.218223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032105.218342:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857018240 00000100:00100000:1.0:1787032105.218351:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857018240 00000100:00100000:1.0:1787032105.218430:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787032105.218439:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857018240:12345-0@lo:13: 00002000:00000024:1.0:1787032105.218498:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032105.218596:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857018240:12345-0@lo:13: Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032105.218603:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787032105.218676:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4875500 x1873838857018240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032105.218695:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857018240:0@lo:13: 00010000:00010000:2.0:1787032105.601401:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032106.632574:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032107.649396:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787032107.798394:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787032108.674044:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032109.258257:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032109.258520:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834975104 00000100:00100000:0.0:1787032109.258530:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834975104 00000100:00100000:0.0:1787032109.258584:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 110 00000100:00100000:0.0:1787032109.258591:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1873838834975104:12345-192.168.201.48@tcp:250: 00010000:00080000:0.0:1787032109.258619:0:5792:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a@192.168.201.48@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1787032109.258646:0:5792:0:(genops.c:1406:class_connect()) connect: client 0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a, cookie 0xcd047797ef1e9800 00000100:00080000:0.0:1787032109.258789:0:5792:0:(import.c:65:import_set_state_nolock()) ffff99cdefc24000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032109.259167:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+5:2353:x1873838834975104:12345-192.168.201.48@tcp:250: Request processed in 573us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032109.259175:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 110 00000100:00100000:3.0:1787032109.262591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032109.262674:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834974976 00000100:00100000:0.0:1787032109.262685:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834974976 00000100:00100000:0.0:1787032109.262754:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 111 00000100:00100000:0.0:1787032109.262764:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+5:5558:x1873838834974976:12345-192.168.201.48@tcp:101: 00010000:00010000:0.0:1787032109.262779:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032109.262794:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2664 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032109.262841:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032109.262853:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032109.262862:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030c00, rc 0) 00000100:00100000:0.0:1787032109.262913:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+6:5558:x1873838834974976:12345-192.168.201.48@tcp:101: Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032109.262917:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 111 00000100:00100000:3.0:1787032109.265181:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032109.265328:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834975232 00000100:00100000:0.0:1787032109.265336:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834975232 00000100:00100000:0.0:1787032109.265401:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 112 00000100:00100000:0.0:1787032109.265410:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+6:5558:x1873838834975232:12345-192.168.201.48@tcp:501: 00000100:00100000:0.0:1787032109.265901:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+6:5558:x1873838834975232:12345-192.168.201.48@tcp:501: Request processed in 491us (727us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032109.265910:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 112 00000100:00100000:3.0:1787032109.268359:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032109.268731:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834975360 00000100:00100000:2.0:1787032109.268740:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834975360 00000100:00100000:2.0:1787032109.268783:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 113 00000100:00100000:2.0:1787032109.268793:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+6:5558:x1873838834975360:12345-192.168.201.48@tcp:101: 00010000:00010000:2.0:1787032109.268819:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032109.268838:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b266b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.268865:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.268877:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.268885:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6a00, rc 0) 00000100:00100000:2.0:1787032109.268940:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+7:5558:x1873838834975360:12345-192.168.201.48@tcp:101: Request processed in 148us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.268947:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 113 00000100:00100000:3.0:1787032109.270853:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032109.271021:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834975488 00000100:00100000:1.0:1787032109.271029:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834975488 00000100:00100000:1.0:1787032109.271108:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 114 00000100:00100000:1.0:1787032109.271118:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+7:5558:x1873838834975488:12345-192.168.201.48@tcp:501: 00000100:00100000:1.0:1787032109.271405:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5558:x1873838834975488:12345-192.168.201.48@tcp:501: Request processed in 287us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032109.271413:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 114 00000100:00100000:3.0:1787032109.273948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032109.276489:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834975616 00000100:00100000:0.0:1787032109.276506:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834975616 00000100:00100000:0.0:1787032109.276585:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 115 00000100:00100000:0.0:1787032109.276596:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5558:x1873838834975616:12345-192.168.201.48@tcp:503: 00000100:00100000:0.0:1787032109.277626:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5558:x1873838834975616:12345-192.168.201.48@tcp:503: Request processed in 1024us (3679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032109.277636:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 115 00000100:00100000:3.0:1787032109.281274:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032109.281390:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834975744 00000100:00100000:2.0:1787032109.281401:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834975744 00000100:00100000:2.0:1787032109.281497:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 116 00000100:00100000:2.0:1787032109.281506:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5578:x1873838834975744:12345-192.168.201.48@tcp:502: 00000100:00100000:2.0:1787032109.281905:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5578:x1873838834975744:12345-192.168.201.48@tcp:502: Request processed in 309us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.281916:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 116 00000100:00100000:3.0:1787032109.303672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032109.303847:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834975872 00000100:00100000:0.0:1787032109.303857:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834975872 00000100:00100000:0.0:1787032109.303914:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 117 00000100:00100000:0.0:1787032109.303925:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5578:x1873838834975872:12345-192.168.201.48@tcp:502: 00000100:00100000:0.0:1787032109.304241:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5578:x1873838834975872:12345-192.168.201.48@tcp:502: Request processed in 317us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032109.304249:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 117 00000100:00100000:3.0:1787032109.334274:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032109.335886:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834976000 00000100:00100000:2.0:1787032109.335903:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834976000 00000100:00100000:2.0:1787032109.337637:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 118 00000100:00100000:2.0:1787032109.337659:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5558:x1873838834976000:12345-192.168.201.48@tcp:101: 00010000:00010000:2.0:1787032109.337679:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032109.337702:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7000/0xcd047797ef1e9815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2695 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.337737:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7000/0xcd047797ef1e9815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2695 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.337750:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7000/0xcd047797ef1e9815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2695 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.337759:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7000, rc 0) 00000100:00100000:2.0:1787032109.338169:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5558:x1873838834976000:12345-192.168.201.48@tcp:101: Request processed in 517us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.338177:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 118 00000100:00100000:3.0:1787032109.342422:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032109.342526:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834976128 00000100:00100000:1.0:1787032109.342536:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834976128 00000100:00100000:1.0:1787032109.342597:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 119 00000100:00100000:1.0:1787032109.342606:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5558:x1873838834976128:12345-192.168.201.48@tcp:256: 20000000:01000000:1.0:1787032109.342634:0:5792:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787032109.342669:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787032109.342674:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787032109.342677:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787032109.342680:0:5792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787032109.346584:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5558:x1873838834976128:12345-192.168.201.48@tcp:256: Request processed in 3967us (4159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032109.346599:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 119 00000100:00100000:3.0:1787032109.354268:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032109.354387:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834976256 00000100:00100000:2.0:1787032109.354397:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834976256 00000100:00100000:2.0:1787032109.354462:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 120 00000100:00100000:2.0:1787032109.354474:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5558:x1873838834976256:12345-192.168.201.48@tcp:101: 00010000:00010000:2.0:1787032109.354494:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032109.354516:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b269c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.354569:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.354579:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032109.354588:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7a00, rc 0) 00000100:00100000:2.0:1787032109.354654:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5558:x1873838834976256:12345-192.168.201.48@tcp:101: Request processed in 182us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.354670:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 120 00000100:00100000:3.0:1787032109.358819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032109.358967:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834976384 00000100:00100000:1.0:1787032109.358977:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834976384 00000100:00100000:1.0:1787032109.359040:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 121 00000100:00100000:1.0:1787032109.359050:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5558:x1873838834976384:12345-192.168.201.48@tcp:501: 00000100:00100000:1.0:1787032109.359364:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5558:x1873838834976384:12345-192.168.201.48@tcp:501: Request processed in 314us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032109.359382:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 121 00000100:00100000:3.0:1787032109.362205:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032109.362446:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834976512 00000100:00100000:0.0:1787032109.362458:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834976512 00000100:00100000:0.0:1787032109.362518:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 122 00000100:00100000:0.0:1787032109.362529:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5558:x1873838834976512:12345-192.168.201.48@tcp:503: 00000100:00100000:0.0:1787032109.362999:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5558:x1873838834976512:12345-192.168.201.48@tcp:503: Request processed in 470us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032109.363008:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 122 00000100:00100000:3.0:1787032109.368159:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032109.368314:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834976640 00000100:00100000:2.0:1787032109.368324:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834976640 00000100:00100000:2.0:1787032109.368379:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 123 00000100:00100000:2.0:1787032109.368389:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5583:x1873838834976640:12345-192.168.201.48@tcp:502: 00000100:00100000:2.0:1787032109.368722:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5583:x1873838834976640:12345-192.168.201.48@tcp:502: Request processed in 333us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.368731:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 123 00000100:00100000:3.0:1787032109.372271:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032109.372530:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834976768 00000100:00100000:1.0:1787032109.372540:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834976768 00000100:00100000:1.0:1787032109.372600:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 124 00000100:00100000:1.0:1787032109.372610:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5583:x1873838834976768:12345-192.168.201.48@tcp:502: 00000100:00100000:1.0:1787032109.373040:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5583:x1873838834976768:12345-192.168.201.48@tcp:502: Request processed in 429us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032109.373048:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 124 00000100:00100000:3.0:1787032109.377773:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032109.378419:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834976896 00000100:00100000:1.0:1787032109.378428:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834976896 00000100:00100000:1.0:1787032109.378481:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:1.0:1787032109.378490:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1873838834976896:12345-192.168.201.48@tcp:38: 00010000:00080000:1.0:1787032109.378521:0:5798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:1.0:1787032109.378569:0:5798:0:(genops.c:1406:class_connect()) connect: client 5d144536-0f5d-43dc-8f25-f68546215872, cookie 0xcd047797ef1e9823 00000004:00100000:1.0:1787032109.378602:0:5798:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787032109.378608:0:5798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787032109.449642:0:5798:0:(import.c:65:import_set_state_nolock()) ffff99cdfacbf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787032109.449774:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2353:x1873838834976896:12345-192.168.201.48@tcp:38: Request processed in 71283us (72009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032109.449784:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 4 00010000:00010000:2.0:1787032109.697336:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032109.825338:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857018624:0@lo:400: 00000100:00100000:2.0:1787032109.825402:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857018496:0@lo:400: 00000100:00100000:0.0:1787032109.825418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032109.825475:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857018752:0@lo:400: 00000100:00100000:3.0:1787032109.825480:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857018368:0@lo:400: 00000100:00100000:2.0:1787032109.829993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032109.830063:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857019008:0@lo:400: 00000100:00100000:2.0:1787032109.830114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032109.830164:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857018624 00000100:00100000:2.0:1787032109.830170:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857018624 00000100:00100000:2.0:1787032109.830212:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857018496 00000100:00100000:2.0:1787032109.830215:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857018496 00000100:00100000:2.0:1787032109.830246:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787032109.830253:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857018624:12345-0@lo:400: 00000100:00100000:2.0:1787032109.830298:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857018624:12345-0@lo:400: Request processed in 45us (4881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.830304:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787032109.830318:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787032109.830322:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857018496:12345-0@lo:400: 00000100:00100000:2.0:1787032109.830344:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857018496:12345-0@lo:400: Request processed in 22us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.830349:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787032109.830379:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857019008 00000100:00100000:2.0:1787032109.830382:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857019008 00000100:00100000:2.0:1787032109.830411:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787032109.830417:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857019008:12345-0@lo:400: 00000100:00100000:2.0:1787032109.830637:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857019008:12345-0@lo:400: Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.830644:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787032109.830687:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca071180 x1873838857018496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032109.830700:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857018496:0@lo:400: 00010000:00080000:2.0:1787032109.830710:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca073b80 x1873838857019008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032109.830717:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787032109.830733:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857019008:0@lo:400: 00000100:00080000:2.0:1787032109.830902:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032109.830908:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787032109.832105:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca073480 x1873838857018624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032109.832120:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857018624:0@lo:400: 00000100:00100000:1.0:1787032109.833023:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032109.833893:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857018752 00000100:00100000:2.0:1787032109.833902:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857018752 00000100:00100000:2.0:1787032109.833984:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787032109.833994:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857018752:12345-0@lo:400: 00000100:00100000:2.0:1787032109.834099:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857018752:12345-0@lo:400: Request processed in 106us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.834106:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787032109.834117:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca072680 x1873838857018752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032109.834132:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857018752:0@lo:400: 00000100:00080000:1.0:1787032109.834683:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032109.840151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032109.840216:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857018880:0@lo:400: 00000100:00100000:3.0:1787032109.840262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032109.840460:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857018368 00000100:00100000:0.0:1787032109.840468:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857018368 00000100:00100000:0.0:1787032109.840587:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787032109.840598:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857018368:12345-0@lo:400: 00000100:00100000:2.0:1787032109.840603:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857018880 00000100:00100000:2.0:1787032109.840609:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857018880 00000100:00100000:0.0:1787032109.840659:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857018368:12345-0@lo:400: Request processed in 63us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032109.840667:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787032109.840672:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787032109.840680:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857018880:12345-0@lo:400: 00000100:00100000:2.0:1787032109.840722:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857018880:12345-0@lo:400: Request processed in 43us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032109.840730:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787032109.841124:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032109.841155:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857018368:0@lo:400: 00010000:00080000:3.0:1787032109.841170:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca071f80 x1873838857018880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032109.841179:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857018880:0@lo:400: 00000100:00100000:3.0:1787032110.337337:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787032110.337373:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787032110.337374:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857019264:0@lo:13: 00000100:00100000:2.0:1787032110.337382:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857019136:0@lo:13: 00000100:00100000:3.0:1787032110.339263:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032110.339316:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857019264 00000100:00100000:0.0:1787032110.339326:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857019264 00000100:00100000:0.0:1787032110.339384:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787032110.339393:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857019264:12345-0@lo:13: 00002000:00000024:0.0:1787032110.339428:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032110.339587:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857019264:12345-0@lo:13: Request processed in 194us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032110.339595:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787032110.339878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787032110.340034:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4877100 x1873838857019264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032110.340053:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857019264:0@lo:13: 00000100:00100000:0.0:1787032110.343056:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857019136 00000100:00100000:0.0:1787032110.343085:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857019136 00000100:00100000:0.0:1787032110.343211:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032110.343221:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857019136:12345-0@lo:13: 00002000:00000024:0.0:1787032110.343256:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032110.343335:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857019136:12345-0@lo:13: Request processed in 115us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032110.343341:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787032110.343453:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4877800 x1873838857019136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032110.343475:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857019136:0@lo:13: 00000100:00100000:3.0:1787032110.455337:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032110.455398:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032110.455635:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834977024 00000100:00100000:0.0:1787032110.455655:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834977024 00000100:00100000:0.0:1787032110.456192:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834977152 00000100:00100000:0.0:1787032110.456198:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834977152 00000100:00100000:0.0:1787032110.456218:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:0.0:1787032110.456228:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:0:x1873838834977024:12345-192.168.201.48@tcp:41: 00000004:00000024:0.0:1787032110.456277:0:7755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787032110.456334:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:0:x1873838834977024:12345-192.168.201.48@tcp:41: Request processed in 108us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032110.456341:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:0.0:1787032110.456373:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:0.0:1787032110.456380:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:5558:x1873838834977152:12345-192.168.201.48@tcp:41: 00000004:00000024:0.0:1787032110.456392:0:7755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787032110.456412:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:5558:x1873838834977152:12345-192.168.201.48@tcp:41: Request processed in 32us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032110.456417:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00080000:2.0:1787032110.456505:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032110.462203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032110.462421:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834977280 00000100:00100000:0.0:1787032110.462432:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834977280 00000100:00100000:0.0:1787032110.462504:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:0.0:1787032110.462514:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:5558:x1873838834977280:12345-192.168.201.48@tcp:40: 00000100:00100000:0.0:1787032110.462602:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:5558:x1873838834977280:12345-192.168.201.48@tcp:40: Request processed in 89us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032110.462610:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:3.0:1787032110.469495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032110.469598:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834977408 00000100:00100000:2.0:1787032110.469609:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834977408 00000100:00100000:2.0:1787032110.469664:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:2.0:1787032110.469681:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1873838834977408:12345-192.168.201.48@tcp:8: 00010000:00080000:2.0:1787032110.469718:0:6895:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1787032110.469746:0:6895:0:(genops.c:1406:class_connect()) connect: client 5d144536-0f5d-43dc-8f25-f68546215872, cookie 0xcd047797ef1e982a 00002000:00100000:2.0:1787032110.469770:0:6895:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d144536-0f5d-43dc-8f25-f68546215872/ffff99cdc4c93000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787032110.469782:0:6895:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787032110.470191:0:6895:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787032110.470221:0:6895:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c91000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787032110.470296:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2353:x1873838834977408:12345-192.168.201.48@tcp:8: Request processed in 622us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032110.470305:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:3.0:1787032110.480152:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032110.480197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032110.480249:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032110.480698:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834977664 00000100:00100000:1.0:1787032110.480712:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834977664 00000100:00100000:1.0:1787032110.480774:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:1.0:1787032110.480784:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:5558:x1873838834977664:12345-192.168.201.48@tcp:33: 00000100:00100000:0.0:1787032110.481196:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834977536 00000100:00100000:0.0:1787032110.481202:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834977536 00000100:00100000:0.0:1787032110.481240:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:0.0:1787032110.481246:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1873838834977536:12345-192.168.201.48@tcp:8: 00010000:00080000:0.0:1787032110.481283:0:6587:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1787032110.481317:0:6587:0:(genops.c:1406:class_connect()) connect: client 5d144536-0f5d-43dc-8f25-f68546215872, cookie 0xcd047797ef1e9831 00002000:00100000:0.0:1787032110.481327:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d144536-0f5d-43dc-8f25-f68546215872/ffff99cdefc21800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787032110.481338:0:6587:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787032110.481739:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787032110.481771:0:6587:0:(import.c:65:import_set_state_nolock()) ffff99cdefc25800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032110.481858:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2353:x1873838834977536:12345-192.168.201.48@tcp:8: Request processed in 611us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032110.481866:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:2.0:1787032110.484579:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834977792 00000100:00100000:2.0:1787032110.484595:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834977792 00000100:00100000:2.0:1787032110.484677:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 126 00000100:00100000:2.0:1787032110.484688:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838834977792:12345-192.168.201.48@tcp:400: 00000100:00100000:2.0:1787032110.484775:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838834977792:12345-192.168.201.48@tcp:400: Request processed in 88us (4524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032110.484783:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 126 00000004:00080000:1.0:1787032110.508625:0:5800:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27756us 00000004:00200000:1.0:1787032110.520045:0:5800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787032110.520226:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:5558:x1873838834977664:12345-192.168.201.48@tcp:33: Request processed in 39437us (40022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032110.520236:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00010000:00010000:0.0:1787032110.721801:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032110.725033:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032110.725226:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834977920 00000100:00100000:2.0:1787032110.725238:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834977920 00000100:00100000:2.0:1787032110.725305:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:2.0:1787032110.725315:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:5600:x1873838834977920:12345-192.168.201.48@tcp:101: 00010000:00010000:2.0:1787032110.725334:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032110.725369:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b26c6 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032110.725439:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e983f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032110.725453:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e983f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032110.725485:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e983f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032110.725824:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787032110.725830:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032110.725911:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e983f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032110.725943:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26c6 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032110.726163:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e983f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26c6 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032110.726171:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864a00) 00010000:00010000:2.0:1787032110.726174:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032110.726178:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7e00, rc 0) 00000100:00100000:2.0:1787032110.726243:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:5600:x1873838834977920:12345-192.168.201.48@tcp:101: Request processed in 929us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032110.726249:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00010000:00010000:2.0:1787032111.745376:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787032112.518372:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00010000:00010000:0.0:1787032112.770584:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032113.068194:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032113.068316:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834978048 00000100:00100000:1.0:1787032113.068326:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834978048 00000100:00100000:1.0:1787032113.068404:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:1.0:1787032113.068415:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:5652:x1873838834978048:12345-192.168.201.48@tcp:41: 00000100:00080000:2.0:1787032113.068624:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1787032113.068671:0:7755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787032113.068750:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:5652:x1873838834978048:12345-192.168.201.48@tcp:41: Request processed in 328us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032113.068758:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:3.0:1787032113.070992:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032113.071156:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834978176 00000100:00100000:1.0:1787032113.071164:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834978176 00000100:00100000:1.0:1787032113.071233:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:1.0:1787032113.071243:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d144536-0f5d-43dc-8f25-f68546215872+5:5652:x1873838834978176:12345-192.168.201.48@tcp:13: 00002000:00000024:1.0:1787032113.071277:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032113.071350:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d144536-0f5d-43dc-8f25-f68546215872+5:5652:x1873838834978176:12345-192.168.201.48@tcp:13: Request processed in 108us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032113.071357:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00080000:2.0:1787032113.071777:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032113.082172:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032113.082408:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834978304 00000100:00100000:1.0:1787032113.082431:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834978304 00000100:00100000:1.0:1787032113.082513:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:1.0:1787032113.082523:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d144536-0f5d-43dc-8f25-f68546215872+6:5652:x1873838834978304:12345-192.168.201.48@tcp:13: 00002000:00000024:1.0:1787032113.082561:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032113.082627:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d144536-0f5d-43dc-8f25-f68546215872+6:5652:x1873838834978304:12345-192.168.201.48@tcp:13: Request processed in 105us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032113.082634:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00080000:2.0:1787032113.083278:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787032113.794341:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787032113.976412:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000001:00100000:2.0:1787032114.465966:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00010000:00010000:0.0:1787032114.820695:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032114.945306:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857019392:0@lo:400: 00000100:00100000:1.0:1787032114.945383:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032114.945543:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857019392 00000100:00100000:2.0:1787032114.945551:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857019392 00000100:00100000:2.0:1787032114.945601:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787032114.945610:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857019392:12345-0@lo:400: 00000100:00100000:0.0:1787032114.945956:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857019776:0@lo:400: 00000100:00100000:0.0:1787032114.945992:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032114.946027:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032114.946033:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857019904:0@lo:400: 00000100:00100000:0.0:1787032114.946057:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032114.946110:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857019648:0@lo:400: 00000100:00100000:0.0:1787032114.946162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032114.946181:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787032114.946187:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857019520:0@lo:400: 00000100:00100000:0.0:1787032114.946208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032114.946226:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857020032:0@lo:400: 00000100:00100000:0.0:1787032114.946249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032114.946295:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857019904 00000100:00100000:0.0:1787032114.946299:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857019904 00000100:00100000:0.0:1787032114.946336:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857019648 00000100:00100000:0.0:1787032114.946339:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857019648 00000100:00100000:0.0:1787032114.946351:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857019520 00000100:00100000:0.0:1787032114.946353:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857019520 00000100:00100000:0.0:1787032114.946365:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787032114.946371:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857019904:12345-0@lo:400: 00000100:00100000:0.0:1787032114.946410:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857019904:12345-0@lo:400: Request processed in 38us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032114.946417:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787032114.946433:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787032114.946439:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857019648:12345-0@lo:400: 00000100:00100000:0.0:1787032114.946470:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857019648:12345-0@lo:400: Request processed in 32us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032114.946476:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787032114.946500:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787032114.946507:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857019520:12345-0@lo:400: 00000100:00100000:0.0:1787032114.946534:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857019520:12345-0@lo:400: Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032114.946539:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787032114.946562:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857019776 00000100:00100000:0.0:1787032114.946566:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857019776 00000100:00100000:0.0:1787032114.946590:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857020032 00000100:00100000:0.0:1787032114.946593:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857020032 00000100:00100000:0.0:1787032114.946612:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032114.946619:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857019776:12345-0@lo:400: 00000100:00100000:0.0:1787032114.946648:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857019776:12345-0@lo:400: Request processed in 31us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032114.946661:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032114.946673:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787032114.946679:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857020032:12345-0@lo:400: 00000100:00100000:0.0:1787032114.946719:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857020032:12345-0@lo:400: Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032114.946726:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787032114.946772:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857019904:0@lo:400: 00010000:00080000:0.0:1787032114.946785:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca072300 x1873838857019776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032114.946795:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857019776:0@lo:400: 00000100:00100000:0.0:1787032114.946825:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857019520:0@lo:400: 00010000:00080000:0.0:1787032114.946835:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca071500 x1873838857020032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032114.946843:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857020032:0@lo:400: 00000100:00100000:0.0:1787032114.946851:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857019648:0@lo:400: 00000100:00100000:2.0:1787032114.961521:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857019392:12345-0@lo:400: Request processed in 15901us (16126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032114.961538:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787032114.961594:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032114.961599:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032114.961603:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032114.973030:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857019392:0@lo:400: 00000100:00100000:2.0:1787032115.465627:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857020160:0@lo:13: 00000100:00100000:2.0:1787032115.465700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032115.465787:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857020160 00000100:00100000:2.0:1787032115.465796:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857020160 00000100:00100000:2.0:1787032115.465842:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787032115.465851:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857020160:12345-0@lo:13: 00002000:00000024:2.0:1787032115.465887:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032115.465930:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857020160:12345-0@lo:13: Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032115.465938:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787032115.465977:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde481c700 x1873838857020160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032115.466010:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857020160:0@lo:13: 00000100:00100000:1.0:1787032115.469881:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787032115.469906:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857020288:0@lo:13: 00000100:00100000:1.0:1787032115.469973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032115.470033:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857020288 00000100:00100000:1.0:1787032115.470040:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857020288 00000100:00100000:1.0:1787032115.470117:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787032115.470127:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857020288:12345-0@lo:13: 00002000:00000024:1.0:1787032115.470175:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032115.470219:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857020288:12345-0@lo:13: Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032115.470226:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787032115.470278:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdf4877480 x1873838857020288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032115.470295:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857020288:0@lo:13: 00000001:02000400:0.0:1787032115.519826:0:8156:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787032115.842413:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032115.854336:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032115.854379:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032115.854486:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834978432 00000100:00100000:0.0:1787032115.854497:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834978432 00000100:00100000:0.0:1787032115.854557:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 128 00000100:00100000:0.0:1787032115.854567:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2355:x1873838834978432:12345-192.168.201.48@tcp:400: 00000100:00100000:1.0:1787032115.854758:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834978560 00000100:00100000:1.0:1787032115.854762:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834978560 00000100:00100000:1.0:1787032115.854834:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:1.0:1787032115.854852:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834978560:12345-192.168.201.48@tcp:400: 00000100:00080000:2.0:1787032115.854913:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032115.862375:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2355:x1873838834978432:12345-192.168.201.48@tcp:400: Request processed in 7795us (8035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032115.862391:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 128 00000100:00100000:3.0:1787032115.863215:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032115.863275:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032115.863744:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834978560:12345-192.168.201.48@tcp:400: Request processed in 8899us (9361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032115.863756:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:2.0:1787032115.867008:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834978688 00000100:00100000:2.0:1787032115.867022:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834978688 00000100:00080000:3.0:1787032115.867185:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032115.867263:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834978816 00000100:00100000:2.0:1787032115.867268:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834978816 00000100:00100000:2.0:1787032115.867309:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:2.0:1787032115.867320:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834978688:12345-192.168.201.48@tcp:400: 00000100:00100000:3.0:1787032115.867534:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:3.0:1787032115.867545:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834978816:12345-192.168.201.48@tcp:400: 00000100:00100000:3.0:1787032115.867574:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834978816:12345-192.168.201.48@tcp:400: Request processed in 32us (4299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032115.867581:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00080000:3.0:1787032115.867601:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032115.867794:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834978688:12345-192.168.201.48@tcp:400: Request processed in 85us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032115.867801:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00010000:00010000:0.0:1787032116.867893:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032117.890162:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787032118.753611:0:8303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda1da41a0 20000000:00000080:1.0:1787032118.753631:0:8303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cdef89a000 uarg=0000000000000000 20000000:01000000:1.0:1787032118.753678:0:8303:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787032118.753680:0:8303:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787032118.753683:0:8303:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787032118.753688:0:8303:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787032118.753694:0:8303:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787032118.753711:0:8303:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787032118.753714:0:8303:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787032118.754369:0:8303:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787032118.754374:0:8303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787032118.755598:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787032118.756428:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787032118.756487:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787032118.756544:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787032118.756559:0:8303:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787032118.756561:0:8303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787032118.759040:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787032118.760348:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787032118.760404:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787032118.760442:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787032118.760455:0:8303:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787032118.760457:0:8303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787032118.761568:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787032118.766473:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787032118.766610:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787032118.766671:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787032118.766693:0:8303:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787032118.766696:0:8303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787032118.770339:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787032118.770871:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787032118.770937:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787032118.770976:0:8303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1787032118.770992:0:8303:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787032118.771012:0:8303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771030:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e973c expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771038:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771045:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771052:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e979e expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771059:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771099:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771107:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771135:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771143:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771151:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771192:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771215:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 9 pid: 5791 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771230:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020416:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032118.771454:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771464:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 9 pid: 5790 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771473:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020544:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032118.771506:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771515:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 18 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771536:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020672:0@lo:104: 00000100:00100000:0.0:1787032118.771576:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787032118.771609:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771618:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 18 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771626:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020800:0@lo:104: 00000100:00100000:0.0:1787032118.771773:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787032118.771804:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771812:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 18 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771821:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020928:0@lo:104: 00010000:00010000:0.0:1787032118.771844:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e979e expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771852:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e979e expref: 18 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771860:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857021056:0@lo:104: 00010000:00010000:0.0:1787032118.771884:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771893:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 18 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771909:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857021184:0@lo:104: 00010000:00010000:0.0:1787032118.771935:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771942:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 18 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771951:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857021312:0@lo:104: 00010000:00010000:0.0:1787032118.771973:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e973c expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.771981:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e973c expref: 18 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.771989:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857021440:0@lo:104: 00000100:00100000:0.0:1787032118.772007:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032118.772103:0:5781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787032118.772134:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.772162:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.772172:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.772180:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.772208:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.772218:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857020672 00000100:00100000:1.0:1787032118.772224:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857020672 00000100:00100000:1.0:1787032118.772265:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857020800 00000100:00100000:1.0:1787032118.772268:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857020800 00000100:00100000:1.0:1787032118.772280:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857020928 00000100:00100000:1.0:1787032118.772282:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857020928 00000100:00100000:1.0:1787032118.772291:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857021056 00000100:00100000:1.0:1787032118.772293:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857021056 00000100:00100000:1.0:1787032118.772303:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857021184 00000100:00100000:1.0:1787032118.772305:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857021184 00000100:00100000:1.0:1787032118.772313:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857021312 00000100:00100000:1.0:1787032118.772315:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857021312 00000100:00100000:1.0:1787032118.772325:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857021440 00000100:00100000:1.0:1787032118.772327:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857021440 00000100:00100000:1.0:1787032118.772340:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787032118.772348:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+9:8303:x1873838857020672:12345-0@lo:104: 00010000:00010000:1.0:1787032118.772361:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772414:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787032118.772420:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+9:8303:x1873838857020672:12345-0@lo:104: Request processed in 73us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.772428:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787032118.772445:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787032118.772452:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf48ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+8:8303:x1873838857020800:12345-0@lo:104: 00010000:00010000:1.0:1787032118.772460:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772490:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787032118.772495:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf48ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+8:8303:x1873838857020800:12345-0@lo:104: Request processed in 45us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.772508:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787032118.772539:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032118.772545:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+7:8303:x1873838857020928:12345-0@lo:104: 00010000:00010000:1.0:1787032118.772552:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772579:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787032118.772584:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+7:8303:x1873838857020928:12345-0@lo:104: Request processed in 40us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.772589:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032118.772601:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787032118.772607:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+6:8303:x1873838857021056:12345-0@lo:104: 00010000:00010000:1.0:1787032118.772615:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772649:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787032118.772655:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+6:8303:x1873838857021056:12345-0@lo:104: Request processed in 48us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.772660:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787032118.772672:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032118.772678:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:8303:x1873838857021184:12345-0@lo:104: 00010000:00010000:1.0:1787032118.772685:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772711:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787032118.772716:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:8303:x1873838857021184:12345-0@lo:104: Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.772728:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032118.772741:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787032118.772746:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:8303:x1873838857021312:12345-0@lo:104: 00010000:00010000:1.0:1787032118.772755:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772781:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787032118.772786:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:8303:x1873838857021312:12345-0@lo:104: Request processed in 40us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.772791:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787032118.772804:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787032118.772809:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:8303:x1873838857021440:12345-0@lo:104: 00010000:00010000:1.0:1787032118.772816:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772838:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787032118.772843:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:8303:x1873838857021440:12345-0@lo:104: Request processed in 35us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.772848:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787032118.772866:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787032118.772872:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772880:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031400 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032118.772885:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772904:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032118.772912:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032118.772919:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032118.772971:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.772978:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032118.773003:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773012:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0031400/0xcd047797ef1e97f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773027:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787032118.773031:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773036:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030600 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032118.773039:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773046:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032118.773053:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032118.773103:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032118.773119:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773125:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032118.773141:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773149:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e97c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97cf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773159:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787032118.773162:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773168:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032118.773171:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773178:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032118.773186:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032118.773192:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032118.773214:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773220:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032118.773232:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773239:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7775200/0xcd047797ef1e97ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97b3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773249:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787032118.773252:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773258:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031c00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032118.773261:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773268:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032118.773274:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032118.773280:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032118.773292:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773298:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032118.773303:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773310:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0031c00/0xcd047797ef1e979e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e97a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773318:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787032118.773326:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773333:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030e00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032118.773336:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773343:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032118.773350:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032118.773356:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032118.773367:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773373:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032118.773377:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773382:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0030e00/0xcd047797ef1e9790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9797 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773390:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787032118.773393:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773398:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ce02046e00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032118.773401:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773417:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032118.773424:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032118.773429:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032118.773442:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773448:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032118.773452:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773459:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e9766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e976d expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773470:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032118.773474:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773479:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6400 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032118.773482:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773489:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032118.773496:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032118.773506:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032118.773520:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773525:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032118.773529:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773536:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6400/0xcd047797ef1e973c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9743 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.773547:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032118.773549:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032118.773551:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032118.773558:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032118.773569:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857021568:0@lo:103: 00000100:00100000:1.0:1787032118.773604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.773636:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857022080:0@lo:103: 00000100:00100000:1.0:1787032118.773656:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.773675:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787032118.773680:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857021952:0@lo:103: 00000100:00100000:1.0:1787032118.773700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.773725:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857021824:0@lo:103: 00000100:00100000:1.0:1787032118.773745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.773755:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857022336:0@lo:103: 00000100:00100000:1.0:1787032118.773771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.773792:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787032118.773798:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857021696:0@lo:103: 00000100:00100000:1.0:1787032118.773818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.773827:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857022208:0@lo:103: 00000100:00100000:1.0:1787032118.773846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032118.773867:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857021568 00000100:00100000:1.0:1787032118.773872:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857021568 00010000:00010000:1.0:1787032118.773897:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 19 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.773913:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857022080 00000100:00100000:1.0:1787032118.773916:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857022080 00010000:00010000:1.0:1787032118.773926:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 20 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.773936:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857021952 00000100:00100000:1.0:1787032118.773938:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857021952 00010000:00010000:1.0:1787032118.773946:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e979e expref: 21 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.773955:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857021824 00000100:00100000:1.0:1787032118.773958:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857021824 00010000:00010000:1.0:1787032118.773966:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 22 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.773976:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857022336 00000100:00100000:1.0:1787032118.773978:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857022336 00010000:00010000:1.0:1787032118.773987:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e973c expref: 23 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.773997:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857021696 00000100:00100000:1.0:1787032118.773999:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857021696 00010000:00010000:1.0:1787032118.774018:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 24 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.774030:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857022208 00000100:00100000:1.0:1787032118.774033:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857022208 00010000:00010000:1.0:1787032118.774044:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 25 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.774057:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787032118.774063:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+25:3303:x1873838857021568:12345-0@lo:103: 00010000:00010000:1.0:1787032118.774103:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.774109:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 25 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774119:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 25 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774135:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.774165:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+25:3303:x1873838857021568:12345-0@lo:103: Request processed in 102us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.774172:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787032118.774187:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787032118.774193:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+24:3303:x1873838857022080:12345-0@lo:103: 00010000:00010000:1.0:1787032118.774210:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.774214:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 24 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774222:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 24 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774242:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.774265:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+24:3303:x1873838857022080:12345-0@lo:103: Request processed in 73us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.774271:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787032118.774284:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032118.774291:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+23:3303:x1873838857021952:12345-0@lo:103: 00010000:00010000:1.0:1787032118.774298:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.774302:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e979e expref: 23 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774310:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e979e expref: 23 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774319:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.774338:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+23:3303:x1873838857021952:12345-0@lo:103: Request processed in 48us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.774344:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032118.774356:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787032118.774361:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+22:3305:x1873838857021824:12345-0@lo:103: 00010000:00010000:1.0:1787032118.774369:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.774373:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 22 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774380:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 22 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774389:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.774420:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+22:3305:x1873838857021824:12345-0@lo:103: Request processed in 58us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.774426:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787032118.774438:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032118.774444:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+21:3305:x1873838857022336:12345-0@lo:103: 00010000:00010000:1.0:1787032118.774451:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.774455:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e973c expref: 21 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774464:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e973c expref: 21 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774474:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.774493:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+21:3305:x1873838857022336:12345-0@lo:103: Request processed in 49us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.774498:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032118.774510:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787032118.774516:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+20:3305:x1873838857021696:12345-0@lo:103: 00010000:00010000:1.0:1787032118.774523:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.774527:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 20 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774535:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 20 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774545:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.774564:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+20:3305:x1873838857021696:12345-0@lo:103: Request processed in 49us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.774570:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787032118.774591:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787032118.774597:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857022208:12345-0@lo:103: 00010000:00010000:1.0:1787032118.774605:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.774609:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 19 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774617:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 19 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.774627:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.774648:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857022208:12345-0@lo:103: Request processed in 52us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.774655:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787032118.774712:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857021696:0@lo:103: 00000100:00100000:1.0:1787032118.774722:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857022208:0@lo:103: 00000100:00100000:1.0:1787032118.774729:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857021824:0@lo:103: 00000100:00100000:1.0:1787032118.774736:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857022336:0@lo:103: 00000100:00100000:1.0:1787032118.774764:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857021952:0@lo:103: 00000100:00100000:1.0:1787032118.774772:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857021568:0@lo:103: 00000100:00100000:1.0:1787032118.774778:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857022080:0@lo:103: 00010000:00010000:0.0:1787032118.775097:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0030200/0xcd047797ef1e97f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e97f2 expref: 18 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.775169:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020672:0@lo:104: 00010000:00010000:0.0:1787032118.775184:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ce02046000/0xcd047797ef1e97cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e97c8 expref: 17 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.775195:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020800:0@lo:104: 00010000:00010000:0.0:1787032118.775214:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1e97b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e97ac expref: 16 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.775223:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020928:0@lo:104: 00010000:00010000:0.0:1787032118.775243:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e97a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e979e expref: 15 pid: 5791 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.775252:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857021056:0@lo:104: 00010000:00010000:0.0:1787032118.775261:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e9797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9790 expref: 14 pid: 5792 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.775270:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857021184:0@lo:104: 00010000:00010000:0.0:1787032118.775279:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e976d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9766 expref: 13 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.775287:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857021312:0@lo:104: 00010000:00010000:0.0:1787032118.775296:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1e9743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e973c expref: 12 pid: 5790 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032118.775304:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857021440:0@lo:104: 00000100:00100000:0.0:1787032118.782437:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020416:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032118.782452:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8303:1873838857020544:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032118.782496:0:8303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032118.788024:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032118.788062:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032118.788292:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834979072 00000100:00100000:1.0:1787032118.788303:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834979072 00010000:00010000:1.0:1787032118.788343:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 10 pid: 5790 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.788395:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834978944 00000100:00100000:1.0:1787032118.788398:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834978944 00010000:00010000:1.0:1787032118.788411:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 11 pid: 5791 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032118.788426:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:1.0:1787032118.788434:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:2355:x1873838834979072:12345-192.168.201.48@tcp:103: 00010000:00010000:1.0:1787032118.788451:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.788457:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 11 pid: 5790 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788469:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 11 pid: 5790 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788488:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e9807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2664 expref: 11 pid: 5790 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788502:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.788554:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2355:x1873838834979072:12345-192.168.201.48@tcp:103: Request processed in 120us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.788563:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:1.0:1787032118.788580:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:1.0:1787032118.788586:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:2355:x1873838834978944:12345-192.168.201.48@tcp:103: 00010000:00010000:1.0:1787032118.788594:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032118.788598:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 9 pid: 5791 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788619:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 9 pid: 5791 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788629:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e980e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b266b expref: 9 pid: 5791 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788640:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788649:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788666:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788673:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788681:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788687:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788694:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032118.788699:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788707:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788731:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.788743:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032118.788764:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:2355:x1873838834978944:12345-192.168.201.48@tcp:103: Request processed in 177us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032118.788771:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 20 00010000:00010000:0.0:1787032118.788978:0:8303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.788988:0:8303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032118.788996:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9846 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032118.917366:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032119.210319:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032119.211121:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834979200 00000100:00100000:2.0:1787032119.211133:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834979200 00000100:00100000:2.0:1787032119.211204:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 129 00000100:00100000:2.0:1787032119.211215:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:5573:x1873838834979200:12345-192.168.201.48@tcp:101: 00010000:00010000:2.0:1787032119.211232:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032119.211251:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e984d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b26cd expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032119.211279:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e984d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26cd expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032119.211291:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e984d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26cd expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032119.211300:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7800, rc 0) 00000100:00100000:2.0:1787032119.211356:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5573:x1873838834979200:12345-192.168.201.48@tcp:101: Request processed in 143us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032119.211377:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 129 00000100:00100000:3.0:1787032119.213475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032119.213655:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834979328 00000100:00100000:0.0:1787032119.213664:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834979328 00000100:00100000:0.0:1787032119.213712:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 130 00000100:00100000:0.0:1787032119.213721:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5573:x1873838834979328:12345-192.168.201.48@tcp:501: 00000100:00100000:0.0:1787032119.214262:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5573:x1873838834979328:12345-192.168.201.48@tcp:501: Request processed in 539us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032119.214269:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 130 00000100:00100000:3.0:1787032119.219686:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032119.220044:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834979456 00000100:00100000:2.0:1787032119.220054:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834979456 00000100:00100000:2.0:1787032119.220133:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 131 00000100:00100000:2.0:1787032119.220142:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5573:x1873838834979456:12345-192.168.201.48@tcp:503: 00000100:00100000:2.0:1787032119.220389:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5573:x1873838834979456:12345-192.168.201.48@tcp:503: Request processed in 247us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032119.220398:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 131 00000100:00100000:3.0:1787032119.223213:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032119.225999:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834979584 00000100:00100000:0.0:1787032119.226013:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834979584 00000100:00100000:0.0:1787032119.226156:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 132 00000100:00100000:0.0:1787032119.226166:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:6040:x1873838834979584:12345-192.168.201.48@tcp:502: 00000100:00100000:0.0:1787032119.226475:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:6040:x1873838834979584:12345-192.168.201.48@tcp:502: Request processed in 308us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032119.226483:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 132 00000100:00100000:3.0:1787032119.230592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032119.241745:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834979712 00000100:00100000:2.0:1787032119.241762:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834979712 00000100:00100000:2.0:1787032119.245412:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 133 00000100:00100000:2.0:1787032119.245425:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:6040:x1873838834979712:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787032119.245775:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:6040:x1873838834979712:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 351us (15192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032119.245854:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 133 00000100:00100000:3.0:1787032119.248844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032119.248954:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834979840 00000100:00100000:1.0:1787032119.248963:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834979840 00000100:00100000:1.0:1787032119.249019:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 134 00000100:00100000:1.0:1787032119.249029:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5573:x1873838834979840:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032119.249045:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032119.249063:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e9854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b26d4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032119.249118:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e9854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26d4 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032119.249129:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e9854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26d4 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032119.249137:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774800, rc 0) 00000100:00100000:1.0:1787032119.249203:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5573:x1873838834979840:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 Request processed in 175us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032119.249211:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 134 00000100:00100000:3.0:1787032119.251577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032119.251863:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834979968 00000100:00100000:1.0:1787032119.251884:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834979968 00000100:00100000:1.0:1787032119.251926:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 135 00000100:00100000:1.0:1787032119.251935:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5573:x1873838834979968:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032119.252605:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5573:x1873838834979968:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 Request processed in 667us (1033us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787032119.252614:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 135 00010000:00010000:1.0:1787032119.939380:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787032120.067064:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787032120.067105:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cdc4c91800 from 39 10000000:01000000:0.0:1787032120.067111:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787032120.067158:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.067171:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.067192:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032120.067219:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857022464:0@lo:101: 00000100:00100000:0.0:1787032120.067300:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.067356:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.067719:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdefbd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857022720:0@lo:400: 00000100:00100000:3.0:1787032120.067751:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.067793:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787032120.067800:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdefbd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857022592:0@lo:400: 00000100:00100000:3.0:1787032120.067823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.067852:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdefbd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857023104:0@lo:400: 00000100:00100000:3.0:1787032120.068320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.068473:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdefbd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857022848:0@lo:400: 00000100:00100000:3.0:1787032120.068516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.068565:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787032120.068572:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdefbd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857022976:0@lo:400: 00000100:00100000:3.0:1787032120.068596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.070828:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857022720 00000100:00100000:3.0:1787032120.070845:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857022720 00000100:00100000:3.0:1787032120.070926:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857022592 00000100:00100000:3.0:1787032120.070929:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857022592 00000100:00100000:3.0:1787032120.070945:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857022976 00000100:00100000:3.0:1787032120.070948:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857022976 00000100:00100000:3.0:1787032120.070970:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787032120.070979:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857022720:12345-0@lo:400: 00000100:00100000:3.0:1787032120.071242:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857022720:12345-0@lo:400: Request processed in 108us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.071250:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787032120.071270:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787032120.071277:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857022592:12345-0@lo:400: 00000100:00100000:3.0:1787032120.071310:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857022592:12345-0@lo:400: Request processed in 34us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.071316:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787032120.071328:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787032120.071395:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857022976:12345-0@lo:400: 00000100:00100000:3.0:1787032120.071432:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857022976:12345-0@lo:400: Request processed in 98us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.071439:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787032120.071493:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857023104 00000100:00100000:3.0:1787032120.071498:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857023104 00000100:00100000:3.0:1787032120.071528:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857022848 00000100:00100000:3.0:1787032120.071532:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857022848 00000100:00100000:3.0:1787032120.071568:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787032120.071574:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857023104:12345-0@lo:400: 00000100:00100000:3.0:1787032120.071608:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857023104:12345-0@lo:400: Request processed in 34us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.071793:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857022464 00000100:00100000:1.0:1787032120.071798:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857022464 00000100:00100000:1.0:1787032120.071833:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787032120.071840:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+12:5794:x1873838857022464:12345-0@lo:101: 00010000:00010000:1.0:1787032120.071851:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032120.071885:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e9862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e985b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.071912:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e9862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e985b expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.071926:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e9862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e985b expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.071938:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775800, rc 0) 00000100:00100000:1.0:1787032120.071974:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857022464:12345-0@lo:101: Request processed in 135us (4675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.071980:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787032120.072098:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857022464:0@lo:101: 00010000:00010000:1.0:1787032120.072120:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.072144:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.072225:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857023232:0@lo:501: 00000100:00100000:1.0:1787032120.072259:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.072286:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.072307:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857023232 00000100:00100000:1.0:1787032120.072310:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857023232 00000100:00100000:1.0:1787032120.072332:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787032120.072350:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857023232:12345-0@lo:501: 00000100:00100000:1.0:1787032120.072596:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857023232:12345-0@lo:501: Request processed in 247us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.072603:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787032120.073313:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787032120.073410:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857023232:0@lo:501: 00000100:00100000:1.0:1787032120.073445:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857023360:0@lo:503: 00000100:00100000:1.0:1787032120.073490:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.073514:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.073526:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857023360 00000100:00100000:1.0:1787032120.073530:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857023360 00000100:00100000:1.0:1787032120.073555:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787032120.073562:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857023360:12345-0@lo:503: 00000100:00100000:1.0:1787032120.073731:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857023360:12345-0@lo:503: Request processed in 167us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.073738:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787032120.073778:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857023360:0@lo:503: 00000100:00100000:0.0:1787032120.085654:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787032120.085685:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857022848:12345-0@lo:400: 00000100:00100000:0.0:1787032120.085782:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857022848:12345-0@lo:400: Request processed in 114us (17264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.085790:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787032120.085871:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787032120.085876:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032120.085880:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032120.086533:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8323:1873838857023488:0@lo:502: 00000100:00100000:0.0:1787032120.086588:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.086633:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.086660:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857023488 00000100:00100000:0.0:1787032120.086666:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857023488 00000100:00100000:0.0:1787032120.086702:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787032120.086709:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:8323:x1873838857023488:12345-0@lo:502: 00000100:00100000:0.0:1787032120.087290:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+13:8323:x1873838857023488:12345-0@lo:502: Request processed in 580us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.087297:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787032120.087650:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8323:1873838857023488:0@lo:502: 00000100:00100000:0.0:1787032120.087701:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8323:1873838857023616:0@lo:502: 00000100:00100000:0.0:1787032120.087737:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.087754:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.087782:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857023616 00000100:00100000:0.0:1787032120.087786:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857023616 00000100:00100000:0.0:1787032120.087811:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787032120.087825:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:8323:x1873838857023616:12345-0@lo:502: 00000100:00100000:0.0:1787032120.087967:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:8323:x1873838857023616:12345-0@lo:502: Request processed in 142us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.087973:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787032120.088012:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8323:1873838857023616:0@lo:502: 00000040:00080000:0.0:1787032120.088030:0:8323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787032120.092274:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787032120.092319:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787032120.092331:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.092344:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032120.092353:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787032120.092357:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787032120.092359:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787032120.092396:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.092404:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.092415:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032120.092442:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857023744:0@lo:101: 00000100:00100000:0.0:1787032120.092504:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.092533:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.092571:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857023744 00000100:00100000:0.0:1787032120.092578:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857023744 00000100:00100000:0.0:1787032120.092623:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787032120.092631:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+13:5794:x1873838857023744:12345-0@lo:101: 00010000:00010000:0.0:1787032120.092644:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032120.092658:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9869 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.092681:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9869 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.092691:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9869 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.092700:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0031e00, rc 0) 00000100:00100000:0.0:1787032120.092738:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857023744:12345-0@lo:101: Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.092745:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787032120.092792:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857023744:0@lo:101: 00010000:00010000:0.0:1787032120.092806:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.092815:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032120.092860:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857023872:0@lo:501: 00000100:00100000:0.0:1787032120.092884:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.092896:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.092907:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857023872 00000100:00100000:0.0:1787032120.092916:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857023872 00000100:00100000:0.0:1787032120.092937:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787032120.092943:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857023872:12345-0@lo:501: 00000100:00100000:0.0:1787032120.093225:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857023872:12345-0@lo:501: Request processed in 280us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.093232:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787032120.093261:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857023872:0@lo:501: 00000100:00100000:0.0:1787032120.093285:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857024000:0@lo:503: 00000100:00100000:0.0:1787032120.093321:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.093333:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.093344:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857024000 00000100:00100000:0.0:1787032120.093347:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857024000 00000100:00100000:0.0:1787032120.093367:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787032120.093373:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857024000:12345-0@lo:503: 00000100:00100000:0.0:1787032120.093510:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857024000:12345-0@lo:503: Request processed in 136us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.093517:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787032120.093554:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857024000:0@lo:503: 00000100:00100000:0.0:1787032120.093833:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8324:1873838857024128:0@lo:502: 00000100:00100000:0.0:1787032120.093864:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.093882:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857024128 00000100:00100000:0.0:1787032120.093885:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857024128 00000100:00100000:0.0:1787032120.093906:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787032120.093912:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:8324:x1873838857024128:12345-0@lo:502: 00000100:00100000:0.0:1787032120.094032:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:8324:x1873838857024128:12345-0@lo:502: Request processed in 119us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.094047:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787032120.094097:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.094109:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8324:1873838857024128:0@lo:502: 00000020:01000000:0.0:1787032120.094129:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032120.094138:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032120.094141:0:8324:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787032120.094146:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787032120.094166:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8324:1873838857024256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.100840:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdefbd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857022592:0@lo:400: 00010000:00080000:3.0:1787032120.100865:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdefbd3b80 x1873838857023104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032120.100877:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdefbd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857023104:0@lo:400: 00000100:00100000:3.0:1787032120.100891:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdefbd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857022720:0@lo:400: 00000100:00100000:3.0:1787032120.100938:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdefbd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857022976:0@lo:400: 00010000:00080000:3.0:1787032120.100951:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdefbd0000 x1873838857022848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032120.100961:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdefbd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857022848:0@lo:400: 00000100:00100000:0.0:1787032120.102291:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.102348:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.102511:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857024256 00000100:00100000:3.0:1787032120.102518:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857024256 00000100:00100000:3.0:1787032120.102568:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787032120.102578:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+14:8324:x1873838857024256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.102948:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+14:8324:x1873838857024256:12345-0@lo:502:llog_process_th.0 Request processed in 371us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.102957:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787032120.103053:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8324:1873838857024256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787032120.103124:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032120.103131:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032120.103134:0:8324:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787032120.103138:0:8324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787032120.103211:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787032120.103226:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787032120.103236:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.103247:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032120.103257:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787032120.103259:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cdefa84800 from 39 10000000:01000000:1.0:1787032120.103263:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787032120.103294:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.103302:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.103310:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.103330:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857024384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.103374:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.103391:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc892f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.103404:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857024384 00000100:00100000:1.0:1787032120.103417:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857024384 00000100:00100000:1.0:1787032120.103443:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787032120.103448:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+14:5794:x1873838857024384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032120.103457:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032120.103471:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774400/0xcd047797ef1e987e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9877 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.103492:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774400/0xcd047797ef1e987e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9877 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.103503:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774400/0xcd047797ef1e987e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9877 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.103511:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774400, rc 0) 00000100:00100000:1.0:1787032120.103539:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857024384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.103545:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787032120.103574:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857024384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032120.103585:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.103593:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.103649:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857024512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.103673:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.103696:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.103707:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857024512 00000100:00100000:1.0:1787032120.103716:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857024512 00000100:00100000:1.0:1787032120.103734:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787032120.103740:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857024512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.103951:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857024512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.103957:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787032120.103985:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857024512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.104010:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857024640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.104041:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.104054:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.104084:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857024640 00000100:00100000:1.0:1787032120.104088:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857024640 00000100:00100000:1.0:1787032120.104105:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787032120.104110:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857024640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.104243:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857024640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.104249:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787032120.104283:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857024640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787032120.108585:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8325:1873838857024768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032120.109243:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.109287:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.109512:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857024768 00000100:00100000:1.0:1787032120.109521:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857024768 00000100:00100000:1.0:1787032120.109571:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787032120.109580:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:8325:x1873838857024768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032120.109907:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+15:8325:x1873838857024768:12345-0@lo:502:llog_process_th.0 Request processed in 327us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.109915:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787032120.111492:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8325:1873838857024768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032120.111560:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8325:1873838857024896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032120.111614:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.111653:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.111728:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857024896 00000100:00100000:3.0:1787032120.111735:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857024896 00000100:00100000:3.0:1787032120.111782:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787032120.111790:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:8325:x1873838857024896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.112010:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:8325:x1873838857024896:12345-0@lo:502:llog_process_th.0 Request processed in 219us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.112018:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787032120.112228:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8325:1873838857024896:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787032120.112248:0:8325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787032120.112690:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787032120.112708:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787032120.112716:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.112727:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032120.112737:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787032120.112739:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787032120.112742:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787032120.112766:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.112773:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.112782:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032120.112798:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.112832:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.112866:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.112914:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857025024 00000100:00100000:0.0:1787032120.112919:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857025024 00000100:00100000:0.0:1787032120.112952:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787032120.112958:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+15:5794:x1873838857025024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787032120.112968:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032120.112980:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e988c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9885 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.113007:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e988c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9885 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.113016:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e988c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9885 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032120.113025:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030c00, rc 0) 00000100:00100000:0.0:1787032120.113116:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857025024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.113122:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787032120.116915:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032120.116943:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.116972:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032120.117047:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.117230:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.117370:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.119439:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857025152 00000100:00100000:1.0:1787032120.119450:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857025152 00000100:00100000:1.0:1787032120.119548:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787032120.119559:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857025152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.119906:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857025152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.119914:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787032120.120111:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.120162:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.120220:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.120254:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.120268:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857025280 00000100:00100000:3.0:1787032120.120272:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857025280 00000100:00100000:3.0:1787032120.120444:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787032120.120452:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857025280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.120604:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857025280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.120611:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787032120.120649:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.120922:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8326:1873838857025408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.120953:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.120970:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857025408 00000100:00100000:3.0:1787032120.120973:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857025408 00000100:00100000:3.0:1787032120.120989:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787032120.120994:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:8326:x1873838857025408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.121143:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:8326:x1873838857025408:12345-0@lo:502:llog_process_th.0 Request processed in 147us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.121150:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787032120.121191:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.121203:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8326:1873838857025408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787032120.121222:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032120.121229:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032120.121232:0:8326:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787032120.121236:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787032120.121254:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8326:1873838857025536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.121459:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.121512:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.121603:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857025536 00000100:00100000:1.0:1787032120.121607:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857025536 00000100:00100000:1.0:1787032120.121629:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787032120.121634:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:8326:x1873838857025536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032120.121745:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:8326:x1873838857025536:12345-0@lo:502:llog_process_th.0 Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.121751:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787032120.121825:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8326:1873838857025536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787032120.121841:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032120.121845:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032120.121847:0:8326:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787032120.121850:0:8326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787032120.121988:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787032120.122006:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787032120.122015:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.122026:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032120.122035:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787032120.122038:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cde4b73800 from 39 10000000:01000000:1.0:1787032120.122041:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787032120.122088:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.122098:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.122114:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.122128:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.122155:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.122172:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdca079600 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.122245:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857025664 00000100:00100000:3.0:1787032120.122250:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857025664 00000100:00100000:3.0:1787032120.122272:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787032120.122342:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857025664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032120.122352:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032120.122366:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ce02047600/0xcd047797ef1e989a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9893 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.122386:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ce02047600/0xcd047797ef1e989a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9893 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.122406:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ce02047600/0xcd047797ef1e989a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9893 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.122414:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ce02047600, rc 0) 00000100:00100000:3.0:1787032120.122444:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857025664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.122450:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787032120.122477:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032120.122489:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.122497:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032120.122535:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.122559:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.122571:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.122581:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857025792 00000100:00100000:3.0:1787032120.122584:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857025792 00000100:00100000:3.0:1787032120.122599:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787032120.122603:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857025792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.122810:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857025792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.122816:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787032120.122840:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.122869:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.122901:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.122914:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.122924:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857025920 00000100:00100000:3.0:1787032120.122927:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857025920 00000100:00100000:3.0:1787032120.122941:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787032120.122945:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857025920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.123055:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857025920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.123062:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787032120.123119:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857025920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.123777:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8327:1873838857026048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.123813:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.123837:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.123931:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857026048 00000100:00100000:0.0:1787032120.123936:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857026048 00000100:00100000:3.0:1787032120.124020:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787032120.124028:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:8327:x1873838857026048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.124227:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:8327:x1873838857026048:12345-0@lo:502:llog_process_th.0 Request processed in 199us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.124235:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787032120.124272:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8327:1873838857026048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.124391:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8327:1873838857026176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.124424:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.124443:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857026176 00000100:00100000:3.0:1787032120.124451:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857026176 00000100:00100000:3.0:1787032120.124468:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787032120.124474:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:8327:x1873838857026176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.124581:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:8327:x1873838857026176:12345-0@lo:502:llog_process_th.0 Request processed in 106us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.124587:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787032120.124616:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.124628:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8327:1873838857026176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787032120.124644:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787032120.124687:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787032120.124701:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787032120.124710:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.124719:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032120.124727:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787032120.124730:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787032120.124732:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787032120.124752:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.124758:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.124765:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032120.124786:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857026304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.124810:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.124822:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.124833:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857026304 00000100:00100000:3.0:1787032120.124836:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857026304 00000100:00100000:3.0:1787032120.124851:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787032120.124856:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857026304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032120.124863:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032120.124874:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ce02046000/0xcd047797ef1e98a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e98a1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.124891:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ce02046000/0xcd047797ef1e98a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e98a1 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.124901:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ce02046000/0xcd047797ef1e98a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e98a1 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.124909:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ce02046000, rc 0) 00000100:00100000:3.0:1787032120.124935:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857026304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.124941:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787032120.124966:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857026304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032120.124977:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.124985:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032120.125027:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857026432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.125050:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.125062:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.125089:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857026432 00000100:00100000:3.0:1787032120.125093:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857026432 00000100:00100000:3.0:1787032120.125107:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787032120.125112:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857026432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.125651:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857026432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 536us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.125658:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787032120.127510:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857026432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.127616:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857026560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.127682:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.127719:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.127769:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857026560 00000100:00100000:1.0:1787032120.127775:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857026560 00000100:00100000:1.0:1787032120.127821:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787032120.127830:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857026560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.128006:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857026560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.128014:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787032120.128149:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857026560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032120.128508:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8328:1873838857026688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032120.128544:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.128573:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39780 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.128612:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857026688 00000100:00100000:3.0:1787032120.128616:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857026688 00000100:00100000:3.0:1787032120.128646:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787032120.128652:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:8328:x1873838857026688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.128822:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:8328:x1873838857026688:12345-0@lo:502:llog_process_th.0 Request processed in 169us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.128829:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787032120.128920:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8328:1873838857026688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787032120.128942:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032120.128950:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032120.128953:0:8328:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787032120.128958:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787032120.128977:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8328:1873838857026816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032120.129008:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032120.129030:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787032120.129090:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857026816 00000100:00100000:3.0:1787032120.129094:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857026816 00000100:00100000:3.0:1787032120.129120:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787032120.129132:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:8328:x1873838857026816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032120.129271:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:8328:x1873838857026816:12345-0@lo:502:llog_process_th.0 Request processed in 139us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032120.129277:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787032120.129386:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8328:1873838857026816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787032120.129406:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032120.129410:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032120.129412:0:8328:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787032120.129417:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787032120.129619:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787032120.129637:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787032120.129647:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.129658:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032120.129668:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787032120.129671:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99cdc7654d40 from 1 10000000:01000000:3.0:1787032120.129673:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787032120.129698:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.129706:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.129715:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032120.129730:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857026944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.129756:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.129818:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8906780 going to sleep for 11 seconds 00000100:00100000:1.0:1787032120.129991:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857026944 00000100:00100000:1.0:1787032120.129995:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857026944 00000100:00100000:1.0:1787032120.130059:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787032120.130096:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857026944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032120.130116:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032120.130130:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7775000/0xcd047797ef1e98b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e98af expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.130151:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7775000/0xcd047797ef1e98b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e98af expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.130161:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7775000/0xcd047797ef1e98b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e98af expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.130169:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775000, rc 0) 00000100:00100000:1.0:1787032120.130209:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857026944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.130215:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787032120.130289:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857026944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032120.130310:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98b6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.130319:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e98b6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032120.130362:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857027072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032120.130386:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032120.133704:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8906780 going to sleep for 11 seconds 00000100:00100000:0.0:1787032120.137560:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857027072 00000100:00100000:0.0:1787032120.137575:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857027072 00000100:00100000:0.0:1787032120.137658:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787032120.137666:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857027072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032120.137952:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857027072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (7564us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032120.137965:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787032120.139815:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857027072:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787032120.139858:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787032120.139868:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98b6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032120.139879:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98b6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032120.577599:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032120.577634:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857027200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032120.577719:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.577956:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857027200 00000100:00100000:1.0:1787032120.577964:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857027200 00000100:00100000:1.0:1787032120.578104:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787032120.578114:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857027200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032120.578152:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032120.578217:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857027200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.578225:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787032120.578265:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c5f80 x1873838857027200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032120.578293:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857027200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032120.586108:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787032120.586132:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857027328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032120.586222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032120.586410:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857027328 00000100:00100000:1.0:1787032120.586419:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857027328 00000100:00100000:1.0:1787032120.586470:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787032120.586479:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857027328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787032120.586515:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032120.586563:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857027328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.586570:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787032120.586711:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c5f80 x1873838857027328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032120.586730:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857027328:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1787032120.746400:0:8364:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcde668f10 20000000:00000080:3.0:1787032120.746419:0:8364:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cdffa79000 uarg=0000000000000000 20000000:01000000:3.0:1787032120.746456:0:8364:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787032120.746462:0:8364:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787032120.746466:0:8364:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787032120.749869:0:8365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787032120.750086:0:8364:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787032120.759273:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787032120.759332:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787032120.759390:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787032120.759413:0:8364:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787032120.759435:0:8364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759453:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc1536a00/0xcd047797ef1e9686 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e967f expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759462:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759469:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759478:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759494:0:8364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759536:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759551:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 9 pid: 5791 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.759567:0:8364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1873838857027456:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032120.759691:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759702:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 18 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.759711:0:8364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1873838857027584:0@lo:104: 00000100:00100000:1.0:1787032120.759765:0:8364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787032120.759812:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759821:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 18 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.759829:0:8364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1873838857027712:0@lo:104: 00000100:00100000:2.0:1787032120.759855:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857027584 00000100:00100000:1.0:1787032120.759855:0:8364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032120.759864:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857027584 00010000:00010000:1.0:1787032120.759877:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc1536a00/0xcd047797ef1e9686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e967f expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.759898:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc1536a00/0xcd047797ef1e9686 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e967f expref: 18 pid: 5792 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.759908:0:8364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1873838857027840:0@lo:104: 00000100:00100000:2.0:1787032120.759919:0:5781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787032120.759931:0:8364:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd92bab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787032120.759945:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032120.759958:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857027712 00000100:00100000:2.0:1787032120.759962:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857027712 00000100:00100000:2.0:1787032120.759977:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857027840 00000100:00100000:2.0:1787032120.759979:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857027840 00000100:00100000:2.0:1787032120.759994:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787032120.760002:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:8364:x1873838857027584:12345-0@lo:104: 00010000:00010000:2.0:1787032120.760016:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760133:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787032120.760140:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:8364:x1873838857027584:12345-0@lo:104: Request processed in 139us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032120.760148:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787032120.760180:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787032120.760187:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdface2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:8364:x1873838857027712:12345-0@lo:104: 00010000:00010000:2.0:1787032120.760196:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760231:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787032120.760236:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdface2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:8364:x1873838857027712:12345-0@lo:104: Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032120.760242:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787032120.760402:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787032120.760411:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:8364:x1873838857027840:12345-0@lo:104: 00010000:00010000:2.0:1787032120.760419:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760449:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787032120.760455:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:8364:x1873838857027840:12345-0@lo:104: Request processed in 47us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032120.760461:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787032120.760482:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787032120.760489:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760497:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ce02047a00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:2.0:1787032120.760508:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760517:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787032120.760525:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032120.760531:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787032120.760573:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760580:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787032120.760602:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760609:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99ce02047a00/0xcd047797ef1e9758 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e975f expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760624:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787032120.760628:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760634:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537800 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:2.0:1787032120.760638:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760645:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787032120.760661:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032120.760666:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787032120.760681:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760688:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787032120.760705:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760712:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1537800/0xcd047797ef1e96f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e96fd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760722:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032120.760726:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760731:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030800 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:2.0:1787032120.760734:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760740:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787032120.760746:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032120.760751:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787032120.760774:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760780:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787032120.760787:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760793:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e967f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9686 expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.760806:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032120.760808:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032120.760809:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032120.760816:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032120.760827:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857027968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787032120.760856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032120.760900:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857028096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787032120.760924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032120.760941:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032120.760945:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857028224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787032120.760963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032120.760985:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857027968 00000100:00100000:2.0:1787032120.760989:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857027968 00010000:00010000:2.0:1787032120.761007:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 19 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032120.761022:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857028096 00000100:00100000:2.0:1787032120.761025:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857028096 00010000:00010000:2.0:1787032120.761034:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 20 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032120.761058:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857028224 00000100:00100000:2.0:1787032120.761098:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857028224 00010000:00010000:2.0:1787032120.761111:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc1536a00/0xcd047797ef1e9686 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e967f expref: 21 pid: 5792 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032120.761125:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787032120.761130:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+21:3305:x1873838857027968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787032120.761140:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032120.761145:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 21 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.761153:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 21 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.761180:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032120.761210:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+21:3305:x1873838857027968:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032120.761216:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787032120.761229:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787032120.761235:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+20:3302:x1873838857028096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787032120.761241:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032120.761245:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 20 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.761253:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 20 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.761262:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032120.761645:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+20:3302:x1873838857028096:12345-0@lo:103:ldlm_bl.0 Request processed in 409us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032120.761653:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787032120.761667:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787032120.761674:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857028224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787032120.761682:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032120.761687:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc1536a00/0xcd047797ef1e9686 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e967f expref: 19 pid: 5792 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.761698:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc1536a00/0xcd047797ef1e9686 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e967f expref: 19 pid: 5792 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.761709:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032120.761732:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857028224:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032120.761738:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787032120.761777:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857027968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787032120.761806:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857028224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787032120.761816:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857028096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032120.762091:0:8364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1873838857027456:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032120.762107:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0030000/0xcd047797ef1e975f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9758 expref: 18 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.762117:0:8364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1873838857027584:0@lo:104: 00010000:00010000:1.0:1787032120.762126:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1537000/0xcd047797ef1e96fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e96f6 expref: 17 pid: 5790 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.762135:0:8364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1873838857027712:0@lo:104: 00010000:00010000:1.0:1787032120.762143:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1536a00/0xcd047797ef1e9686 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e967f expref: 16 pid: 5792 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032120.762150:0:8364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1873838857027840:0@lo:104: 00010000:00010000:1.0:1787032120.762178:0:8364:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032120.763481:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032120.763699:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834980096 00000100:00100000:2.0:1787032120.763706:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834980096 00010000:00010000:2.0:1787032120.763737:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 10 pid: 5791 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032120.763775:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:2.0:1787032120.763784:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2355:x1873838834980096:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032120.763797:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032120.763814:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 10 pid: 5791 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763827:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 10 pid: 5791 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763845:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1e981c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b269c expref: 10 pid: 5791 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763861:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763870:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763886:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763893:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763901:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763908:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763914:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032120.763919:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763927:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763958:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032120.763970:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032120.764118:0:8364:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.764128:0:8364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032120.764135:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7775600/0xcd047797ef1e98bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032120.764358:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:2355:x1873838834980096:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 573us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032120.764366:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 24 00010000:00010000:2.0:1787032120.961286:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032120.964347:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032120.964380:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032120.964420:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032120.964446:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032120.964739:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834980480 00000100:00100000:1.0:1787032120.964749:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834980480 00000100:00100000:1.0:1787032120.964812:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834980608 00000100:00100000:1.0:1787032120.964815:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834980608 00000100:00100000:1.0:1787032120.964836:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:1.0:1787032120.964844:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834980480:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032120.964913:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834980480:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 70us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.964920:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:1.0:1787032120.964935:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:1.0:1787032120.964940:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834980608:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032120.964960:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834980608:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 21us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032120.964966:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00080000:2.0:1787032120.966408:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032120.966427:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787032120.966654:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834980224 00000100:00100000:0.0:1787032120.966663:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834980224 00000100:00100000:0.0:1787032120.966726:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 168 00000100:00100000:0.0:1787032120.966735:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:2355:x1873838834980224:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032120.966814:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:2355:x1873838834980224:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 79us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.966821:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 168 00000100:00100000:0.0:1787032120.967658:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834980352 00000100:00100000:0.0:1787032120.967667:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834980352 00000100:00100000:0.0:1787032120.967728:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:0.0:1787032120.967737:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834980352:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032120.967789:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834980352:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 53us (3376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032120.967796:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00080000:2.0:1787032120.968528:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787032121.995402:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032122.435171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032122.435231:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834980736 00000100:00100000:0.0:1787032122.435244:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834980736 00000100:00100000:0.0:1787032122.435310:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 169 00000100:00100000:0.0:1787032122.435321:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:5573:x1873838834980736:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787032122.435356:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032122.435385:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b26db expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032122.435422:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032122.435437:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032122.435447:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0031400, rc 0) 00000100:00100000:0.0:1787032122.435517:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5573:x1873838834980736:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 Request processed in 198us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032122.435526:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 169 00000100:00100000:2.0:1787032122.448569:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032122.448657:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834980864 00000100:00100000:1.0:1787032122.448671:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834980864 00000100:00100000:1.0:1787032122.448745:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 170 00000100:00100000:1.0:1787032122.448756:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5573:x1873838834980864:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032122.449222:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5573:x1873838834980864:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 Request processed in 466us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032122.449232:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 170 00000100:00100000:3.0:1787032122.456576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032122.456761:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834980992 00000100:00100000:1.0:1787032122.456775:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834980992 00000100:00100000:1.0:1787032122.456847:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 171 00000100:00100000:1.0:1787032122.456878:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5573:x1873838834980992:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032122.457235:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:5573:x1873838834980992:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 Request processed in 360us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032122.457244:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 171 00000100:00100000:3.0:1787032122.465289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032122.466431:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834981120 00000100:00100000:0.0:1787032122.466448:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834981120 00000100:00100000:0.0:1787032122.466511:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 172 00000100:00100000:0.0:1787032122.466522:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:6103:x1873838834981120:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787032122.466776:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:6103:x1873838834981120:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 256us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032122.466785:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 172 00000100:00100000:1.0:1787032122.475004:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032122.475335:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834981248 00000100:00100000:3.0:1787032122.475350:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834981248 00000100:00100000:2.0:1787032122.476162:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 173 00000100:00100000:2.0:1787032122.476173:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:6103:x1873838834981248:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787032122.476498:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:6103:x1873838834981248:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 325us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.476508:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 173 10000000:01000000:3.0:1787032122.561153:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787032122.561170:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdc4c91800 from 4 10000000:01000000:3.0:1787032122.561177:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787032122.561242:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032122.561258:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032122.561272:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032122.561308:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857028352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787032122.561950:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032122.562027:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc6153d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.562123:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857028352 00000100:00100000:2.0:1787032122.562142:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857028352 00000100:00100000:2.0:1787032122.562208:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787032122.562220:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857028352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032122.562238:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032122.562267:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e98cb expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.562299:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.562312:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.562322:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6000, rc 0) 00000100:00100000:2.0:1787032122.562384:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857028352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.562392:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787032122.562502:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857028352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032122.562522:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032122.562533:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032122.562855:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857028480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032122.562891:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032122.562926:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc6153d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.563109:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857028480 00000100:00100000:2.0:1787032122.563116:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857028480 00000100:00100000:2.0:1787032122.563156:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787032122.563165:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857028480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.563507:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857028480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.563516:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787032122.563532:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857028480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032122.563581:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857028608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032122.563651:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032122.563679:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc6153d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.563800:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857028608 00000100:00100000:2.0:1787032122.563805:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857028608 00000100:00100000:2.0:1787032122.563835:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787032122.563842:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857028608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.564015:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857028608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.564022:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787032122.564064:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857028608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.577800:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8437:1873838857028736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032122.577923:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032122.577977:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857028736 00000100:00100000:2.0:1787032122.577986:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857028736 00000100:00100000:2.0:1787032122.578037:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787032122.578046:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:8437:x1873838857028736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032122.579184:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5554a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.582898:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:8437:x1873838857028736:12345-0@lo:502:llog_process_th.0 Request processed in 4835us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.582918:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787032122.596013:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8437:1873838857028736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787032122.596167:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032122.596186:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032122.596189:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787032122.596197:0:8437:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdc4c91800 00000020:00000080:0.0:1787032122.596216:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787032122.596371:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8437:1873838857028864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032122.596474:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032122.596530:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857028864 00000100:00100000:0.0:1787032122.596538:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857028864 00000100:00100000:0.0:1787032122.596608:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787032122.597121:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787032122.599055:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:8437:x1873838857028864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032122.599473:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:8437:x1873838857028864:12345-0@lo:502:llog_process_th.0 Request processed in 444us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032122.599485:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787032122.600219:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8437:1873838857028864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787032122.600281:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032122.600293:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032122.600297:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787032122.600307:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787032122.603489:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787032122.603546:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787032122.603584:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.603601:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032122.603826:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787032122.603830:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdefa84800 from 4 10000000:01000000:2.0:1787032122.603833:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787032122.603889:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.603898:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.603911:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032122.603957:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857028992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.604043:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032122.604125:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5554c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.604163:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857028992 00000100:00100000:2.0:1787032122.604170:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857028992 00000100:00100000:2.0:1787032122.604230:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787032122.604242:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857028992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032122.604258:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032122.604273:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e98d9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.604300:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.604314:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.604325:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6400, rc 0) 00000100:00100000:2.0:1787032122.604371:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857028992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.604379:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787032122.604434:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857028992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032122.604450:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.604461:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032122.604531:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.604573:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032122.604587:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5554c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.604599:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857029120 00000100:00100000:2.0:1787032122.604603:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857029120 00000100:00100000:2.0:1787032122.607527:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787032122.607552:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857029120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.609310:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857029120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1760us (4728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.609322:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787032122.611446:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032122.611524:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032122.611624:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032122.611676:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9e7f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.613317:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857029248 00000100:00100000:2.0:1787032122.613334:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857029248 00000100:00100000:2.0:1787032122.613412:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787032122.613424:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857029248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.615295:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857029248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1694us (3490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.615315:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787032122.615426:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787032122.618199:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8439:1873838857029376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032122.618317:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032122.618372:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc76f33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032122.618794:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857029376 00000100:00100000:3.0:1787032122.618805:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857029376 00000100:00100000:3.0:1787032122.618869:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787032122.618880:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:8439:x1873838857029376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032122.619212:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:8439:x1873838857029376:12345-0@lo:502:llog_process_th.0 Request processed in 333us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032122.619222:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787032122.619869:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8439:1873838857029376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787032122.619917:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032122.619931:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032122.619935:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787032122.619942:0:8439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdefa84800 00000020:00000080:0.0:1787032122.619945:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787032122.620101:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8439:1873838857029504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032122.620188:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032122.620230:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc76f33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.620552:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857029504 00000100:00100000:2.0:1787032122.620562:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857029504 00000100:00100000:2.0:1787032122.621929:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787032122.621959:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:8439:x1873838857029504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032122.622328:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+18:8439:x1873838857029504:12345-0@lo:502:llog_process_th.0 Request processed in 384us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.622349:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787032122.625058:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8439:1873838857029504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787032122.625145:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787032122.625156:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032122.625159:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787032122.625165:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787032122.625288:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787032122.625311:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787032122.625326:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032122.625339:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032122.625350:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787032122.625353:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cde4b73800 from 4 10000000:01000000:1.0:1787032122.625356:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787032122.625401:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032122.625616:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032122.625641:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032122.625692:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787032122.625784:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032122.625833:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfb19f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.626970:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857029632 00000100:00100000:2.0:1787032122.626983:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857029632 00000100:00100000:2.0:1787032122.627057:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787032122.627086:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857029632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032122.627105:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032122.627139:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e98e7 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.627174:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.627188:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.627199:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6c00, rc 0) 00000100:00100000:2.0:1787032122.627278:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857029632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.627286:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787032122.627347:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032122.627367:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.627397:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032122.627479:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.627514:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032122.627535:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5554c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.627550:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857029760 00000100:00100000:2.0:1787032122.627554:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857029760 00000100:00100000:2.0:1787032122.629481:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787032122.629502:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857029760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.630501:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857029760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1000us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.630517:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787032122.630552:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032122.630625:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787032122.630707:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032122.630765:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc76f3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.632001:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857029888 00000100:00100000:2.0:1787032122.632016:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857029888 00000100:00100000:2.0:1787032122.632089:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787032122.632100:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857029888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032122.632441:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857029888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 341us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.632450:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787032122.632709:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857029888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787032122.635465:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8441:1873838857030016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032122.635553:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032122.635592:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc76f33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.635898:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857030016 00000100:00100000:2.0:1787032122.635912:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857030016 00000100:00100000:2.0:1787032122.635972:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787032122.635982:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:8441:x1873838857030016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032122.636368:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:8441:x1873838857030016:12345-0@lo:502:llog_process_th.0 Request processed in 386us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.636383:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787032122.636562:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8441:1873838857030016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787032122.636601:0:8441:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032122.636611:0:8441:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032122.636614:0:8441:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787032122.636622:0:8441:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cde4b73800 00000020:00000080:0.0:1787032122.636625:0:8441:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787032122.636702:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8441:1873838857030144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032122.636756:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032122.636773:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc76f33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032122.637817:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857030144 00000100:00100000:2.0:1787032122.637831:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857030144 00000100:00100000:2.0:1787032122.637896:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787032122.637906:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:8441:x1873838857030144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032122.638195:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:8441:x1873838857030144:12345-0@lo:502:llog_process_th.0 Request processed in 288us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032122.638204:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787032122.638226:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:8441:1873838857030144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787032122.638271:0:8441:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032122.638281:0:8441:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032122.638283:0:8441:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787032122.638287:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787032122.639879:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787032122.639928:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787032122.639944:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032122.639960:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032123.014705:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032124.035162:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032125.058803:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032125.186342:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787032125.189196:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857030400:0@lo:400:kworker.0 00000100:00100000:3.0:1787032125.189271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032125.189375:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857030272:0@lo:400:kworker.0 00000100:00100000:3.0:1787032125.189406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032125.189465:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857030272 00000100:00100000:3.0:1787032125.189473:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857030272 00000100:00100000:3.0:1787032125.189518:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787032125.189526:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857030272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032125.189575:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857030272:12345-0@lo:400:kworker.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032125.189583:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787032125.189628:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857030272:0@lo:400:kworker.0 00000100:00100000:3.0:1787032125.192311:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857030912:0@lo:400:kworker.0 00000100:00100000:3.0:1787032125.192383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032125.192433:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787032125.192441:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857030784:0@lo:400:kworker.0 00000100:00100000:3.0:1787032125.192466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032125.192932:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857030912 00000100:00100000:0.0:1787032125.192940:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857030912 00000100:00100000:0.0:1787032125.193001:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787032125.193009:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857030912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032125.193056:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857030912:12345-0@lo:400:kworker.0 Request processed in 48us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032125.193062:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787032125.194970:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde481dc00 x1873838857030912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032125.194987:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857030912:0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195122:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857030400 00000100:00100000:2.0:1787032125.195129:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857030400 00000100:00080000:2.0:1787032125.195143:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032125.195163:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857030528:0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195314:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032125.195345:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032125.195351:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857030656:0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032125.195531:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857030656 00000100:00100000:2.0:1787032125.195534:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857030656 00000100:00100000:2.0:1787032125.195579:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787032125.195587:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857030656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195629:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857030656:12345-0@lo:400:kworker.0 Request processed in 43us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032125.195636:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787032125.195660:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787032125.195678:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde481d500 x1873838857030656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032125.195688:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857030656:0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195730:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857030784 00000100:00100000:2.0:1787032125.195733:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857030784 00000100:00100000:2.0:1787032125.195748:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857030528 00000100:00100000:2.0:1787032125.195750:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857030528 00000100:00100000:2.0:1787032125.195760:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787032125.195765:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857030400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195796:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857030400:12345-0@lo:400:kworker.0 Request processed in 31us (6526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032125.195802:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787032125.195811:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787032125.195816:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857030784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195836:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857030784:12345-0@lo:400:kworker.0 Request processed in 20us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032125.195841:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787032125.195849:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787032125.195853:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857030528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195874:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857030528:12345-0@lo:400:kworker.0 Request processed in 21us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032125.195885:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787032125.195896:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032125.195909:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857030528:0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195926:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857030784:0@lo:400:kworker.0 00000100:00100000:2.0:1787032125.195935:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857030400:0@lo:400:kworker.0 00000100:00100000:1.0:1787032125.697457:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857031040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032125.697532:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032125.697609:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857031040 00000100:00100000:1.0:1787032125.697617:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857031040 00000100:00100000:1.0:1787032125.697664:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032125.697673:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857031040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787032125.697706:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032125.698036:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032125.698046:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857031168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032125.698103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032125.698137:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787032125.698145:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787032125.698242:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857031168 00000100:00100000:0.0:1787032125.698246:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857031168 00000100:00100000:0.0:1787032125.698325:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787032125.698332:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857031168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032125.698351:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032125.698393:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857031168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032125.698401:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787032125.698440:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde481d880 x1873838857031168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032125.698458:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857031168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032125.698578:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857031040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 906us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032125.698586:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787032125.698651:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c5c00 x1873838857031040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032125.698664:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857031040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787032126.081270:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032126.081834:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032126.081871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032126.081903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032126.081930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032126.081956:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834981504 00000100:00100000:3.0:1787032126.081966:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834981504 00000100:00100000:3.0:1787032126.082028:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00100000:3.0:1787032126.082038:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834981504:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032126.082138:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834981504:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032126.082145:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00100000:3.0:1787032126.082168:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834981632 00000100:00100000:3.0:1787032126.082172:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834981632 00000100:00100000:3.0:1787032126.082211:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834981760 00000100:00100000:3.0:1787032126.082214:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834981760 00000100:00100000:3.0:1787032126.082236:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:3.0:1787032126.082242:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+5:2356:x1873838834981632:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032126.082269:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+5:2356:x1873838834981632:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032126.082288:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:3.0:1787032126.082300:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032126.082306:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+5:2356:x1873838834981760:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032126.082331:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+5:2356:x1873838834981760:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032126.082337:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00080000:3.0:1787032126.082352:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787032126.082355:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787032126.082358:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032126.082879:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834981376 00000100:00100000:2.0:1787032126.082884:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834981376 00000100:00100000:2.0:1787032126.086317:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 190 00000100:00100000:2.0:1787032126.086344:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2356:x1873838834981376:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032126.086432:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2356:x1873838834981376:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 100us (4601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032126.086441:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 190 00000001:02000400:2.0:1787032127.040374:0:8664:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787032127.107308:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032128.134267:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032129.154205:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032130.179749:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032130.306620:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857031296:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.306693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032130.306736:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857031808:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.306762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032130.306788:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787032130.306794:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857031424:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.306831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032130.306863:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857031936:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.306888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032130.306917:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857031552:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.306941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032130.306958:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032130.306963:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857031680:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.306984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032130.307026:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857031296 00000100:00100000:0.0:1787032130.307033:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857031296 00000100:00100000:0.0:1787032130.307097:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787032130.307106:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857031296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307153:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857031296:12345-0@lo:400:kworker.0 Request processed in 48us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032130.307160:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787032130.307193:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857031808 00000100:00100000:0.0:1787032130.307197:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857031808 00000100:00100000:0.0:1787032130.307226:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857031424 00000100:00100000:0.0:1787032130.307229:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857031424 00000100:00100000:0.0:1787032130.307239:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857031552 00000100:00100000:0.0:1787032130.307242:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857031552 00000100:00100000:0.0:1787032130.307255:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787032130.307260:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857031808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307292:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857031808:12345-0@lo:400:kworker.0 Request processed in 32us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032130.307298:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787032130.307308:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787032130.307321:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857031424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307346:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857031424:12345-0@lo:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032130.307352:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787032130.307363:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787032130.307368:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857031552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307395:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857031552:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032130.307402:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787032130.307425:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857031936 00000100:00100000:0.0:1787032130.307428:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857031936 00000100:00100000:0.0:1787032130.307452:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857031680 00000100:00100000:0.0:1787032130.307455:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857031680 00000100:00100000:0.0:1787032130.307475:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787032130.307481:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857031936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307509:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857031936:12345-0@lo:400:kworker.0 Request processed in 28us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032130.307514:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787032130.307526:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787032130.307531:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857031680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307553:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857031680:12345-0@lo:400:kworker.0 Request processed in 23us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032130.307559:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787032130.307576:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787032130.307579:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032130.307582:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787032130.307612:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde481dc00 x1873838857031680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032130.307632:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857031680:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307646:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857031552:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307675:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857031424:0@lo:400:kworker.0 00010000:00080000:0.0:1787032130.307685:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde481ce00 x1873838857031936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032130.307694:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857031936:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307702:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857031296:0@lo:400:kworker.0 00000100:00100000:0.0:1787032130.307710:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857031808:0@lo:400:kworker.0 00000100:00100000:1.0:1787032130.821505:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857032064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032130.821575:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032130.821642:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857032064 00000100:00100000:1.0:1787032130.821649:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857032064 00000100:00100000:1.0:1787032130.821697:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032130.821706:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857032064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787032130.821740:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032130.821794:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857032064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032130.830096:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032130.830149:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857032192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032130.830219:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787032130.830300:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c5f80 x1873838857032064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032130.830321:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857032064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032130.831398:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857032192 00000100:00100000:0.0:1787032130.831409:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857032192 00000100:00100000:0.0:1787032130.831458:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787032130.831467:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857032192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032130.831505:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032130.831566:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857032192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032130.831572:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787032130.831608:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdffe08e00 x1873838857032192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032130.831623:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857032192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032131.207045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032131.207094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032131.207111:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032131.207134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032131.207157:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834982144 00000100:00100000:0.0:1787032131.207166:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834982144 00000100:00100000:0.0:1787032131.207209:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834982272 00000100:00100000:0.0:1787032131.207211:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834982272 00000100:00100000:0.0:1787032131.207225:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:0.0:1787032131.207232:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834982144:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032131.207291:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834982144:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032131.207297:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:0.0:1787032131.207308:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:0.0:1787032131.207312:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834982272:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032131.207324:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834982272:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 13us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032131.207328:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:0.0:1787032131.207339:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834982016 00000100:00100000:0.0:1787032131.207341:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834982016 00000100:00100000:0.0:1787032131.207359:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:0.0:1787032131.207362:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834982016:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032131.207377:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834982016:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 15us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032131.207380:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00080000:0.0:1787032131.207393:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032131.207395:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032131.207397:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787032131.208011:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032131.211019:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834981888 00000100:00100000:2.0:1787032131.211034:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834981888 00000100:00100000:2.0:1787032131.211128:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 192 00000100:00100000:2.0:1787032131.211138:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2355:x1873838834981888:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032131.211645:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2355:x1873838834981888:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 506us (4605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032131.211655:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 192 00000001:02000400:2.0:1787032131.242699:0:8907:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing yml_node 00010000:00010000:2.0:1787032132.225468:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032133.249331:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032134.273327:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032135.297561:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032135.425666:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857032576:0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.425740:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032135.425802:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032135.425810:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857032704:0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.425835:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032135.425939:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857032320:0@lo:400:kworker.0 00000100:00100000:0.0:1787032135.425987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032135.426020:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857032832:0@lo:400:kworker.0 00000100:00100000:0.0:1787032135.426042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032135.426085:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787032135.426092:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857032448:0@lo:400:kworker.0 00000100:00100000:0.0:1787032135.426115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032135.426133:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857032960:0@lo:400:kworker.0 00000100:00100000:0.0:1787032135.426152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032135.426366:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857032320 00000100:00100000:3.0:1787032135.426373:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857032320 00000100:00100000:3.0:1787032135.426421:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787032135.426430:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857032320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.426486:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857032320:12345-0@lo:400:kworker.0 Request processed in 56us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032135.426493:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787032135.426559:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857032576 00000100:00100000:3.0:1787032135.426562:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857032576 00000100:00100000:3.0:1787032135.426594:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857032832 00000100:00100000:3.0:1787032135.426596:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857032832 00000100:00100000:3.0:1787032135.426609:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857032448 00000100:00100000:3.0:1787032135.426618:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857032448 00000100:00100000:3.0:1787032135.426637:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787032135.426643:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857032576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.426680:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857032576:12345-0@lo:400:kworker.0 Request processed in 37us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032135.426686:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787032135.426698:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787032135.426704:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857032832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.426730:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857032832:12345-0@lo:400:kworker.0 Request processed in 26us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032135.426736:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787032135.426747:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787032135.426753:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857032448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.426777:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857032448:12345-0@lo:400:kworker.0 Request processed in 25us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032135.426784:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787032135.426800:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857032704 00000100:00100000:3.0:1787032135.426804:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857032704 00000100:00100000:3.0:1787032135.426841:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857032960 00000100:00100000:3.0:1787032135.426844:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857032960 00000100:00100000:3.0:1787032135.426865:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787032135.426871:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857032704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.426914:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857032704:12345-0@lo:400:kworker.0 Request processed in 43us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032135.426920:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787032135.426931:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787032135.426936:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857032960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.426969:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857032960:12345-0@lo:400:kworker.0 Request processed in 33us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032135.426976:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787032135.427017:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d5b480 x1873838857032704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032135.427031:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857032704:0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.427042:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857032576:0@lo:400:kworker.0 00000100:00080000:3.0:1787032135.427105:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787032135.427109:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787032135.427111:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032135.427141:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857032448:0@lo:400:kworker.0 00010000:00080000:3.0:1787032135.427150:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d58e00 x1873838857032960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032135.427158:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857032960:0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.427166:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857032320:0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.427173:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857032832:0@lo:400:kworker.0 00000100:00100000:3.0:1787032135.937483:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857033088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032135.937594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032135.937836:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857033088 00000100:00100000:1.0:1787032135.937848:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857033088 00000100:00100000:1.0:1787032135.937928:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787032135.937940:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857033088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787032135.937989:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032135.938052:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857033088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032135.938061:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787032135.938242:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c5f80 x1873838857033088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032135.938262:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857033088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032135.953996:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857033216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032135.956803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032135.957903:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857033216 00000100:00100000:1.0:1787032135.957915:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857033216 00000100:00100000:3.0:1787032135.959575:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787032135.959587:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857033216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787032135.959625:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032135.959701:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857033216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032135.959707:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787032135.965933:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdffe0b800 x1873838857033216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032135.965962:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857033216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787032136.322420:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032136.338698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032136.338756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032136.338789:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834982400 00000100:00100000:1.0:1787032136.338797:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834982400 00000100:00100000:3.0:1787032136.338815:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834982528 00000100:00100000:3.0:1787032136.338822:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834982528 00000100:00100000:1.0:1787032136.338848:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 194 00000100:00100000:1.0:1787032136.338859:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838834982400:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032136.338874:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:3.0:1787032136.338895:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834982528:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032136.338963:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838834982400:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032136.338970:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 194 00000100:00100000:3.0:1787032136.340476:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834982528:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 1575us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032136.340488:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00080000:3.0:1787032136.340524:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032136.350027:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032136.350111:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032136.350283:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834982656 00000100:00100000:2.0:1787032136.350299:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834982656 00000100:00100000:2.0:1787032136.350367:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834982784 00000100:00100000:2.0:1787032136.350371:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834982784 00000100:00100000:2.0:1787032136.350396:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:2.0:1787032136.350407:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2353:x1873838834982656:12345-192.168.201.48@tcp:9:kworker.0 00000100:00100000:3.0:1787032136.350416:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:3.0:1787032136.350429:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2353:x1873838834982784:12345-192.168.201.48@tcp:9:kworker.0 00000020:00000080:2.0:1787032136.350445:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e982a 00000020:00000080:3.0:1787032136.350452:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9831 00000100:00080000:3.0:1787032136.350464:0:6584:0:(import.c:65:import_set_state_nolock()) ffff99cdefc25800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787032136.350472:0:6587:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c91000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787032136.350513:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:2.0:1787032136.350513:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787032136.350968:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+2:2353:x1873838834982784:12345-192.168.201.48@tcp:9:kworker.0 Request processed in 540us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032136.350986:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:2.0:1787032136.351226:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+2:2353:x1873838834982656:12345-192.168.201.48@tcp:9:kworker.0 Request processed in 820us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032136.351234:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00010000:00010000:2.0:1787032136.351286:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787032136.351606:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032136.351611:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787032136.357374:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787032136.691623:0:9100:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.55.1 00010000:00010000:1.0:1787032137.345602:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787032138.014392:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:3.0:1787032138.014403:0:6614:0:(genops.c:906:class_export_put()) final put ffff99cdc4c93000/5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:3.0:1787032138.018116:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdc4c93000/5d144536-0f5d-43dc-8f25-f68546215872 for lustre-OST0000 00000020:00000080:3.0:1787032138.018204:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdc4c91000 for lustre-OST0000 00010000:00010000:3.0:1787032138.369246:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032139.393262:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787032139.650376:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:2.0:1787032139.650386:0:7500:0:(genops.c:906:class_export_put()) final put ffff99cdefc21800/5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:2.0:1787032139.650426:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefc21800/5d144536-0f5d-43dc-8f25-f68546215872 for lustre-OST0001 00000020:00000080:2.0:1787032139.650476:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdefc25800 for lustre-OST0001 00000001:02000400:2.0:1787032139.687712:0:9198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.55.1 00010000:00010000:3.0:1787032140.417366:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032140.549199:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857033344:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032140.549331:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857033856:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032140.549383:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787032140.549389:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857033472:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032140.549424:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857033984:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032140.549477:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857033600:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032140.549530:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032140.549536:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857033728:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549557:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032140.549586:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857033856 00000100:00100000:2.0:1787032140.549592:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857033856 00000100:00100000:2.0:1787032140.549639:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857033472 00000100:00100000:2.0:1787032140.549642:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857033472 00000100:00100000:2.0:1787032140.549651:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857033600 00000100:00100000:2.0:1787032140.549654:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857033600 00000100:00100000:2.0:1787032140.549667:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787032140.549675:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857033856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549723:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857033856:12345-0@lo:400:kworker.0 Request processed in 47us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032140.549730:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787032140.549745:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787032140.549751:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857033472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549776:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857033472:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032140.549782:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787032140.549792:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032140.549797:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857033600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549841:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857033600:12345-0@lo:400:kworker.0 Request processed in 43us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032140.549847:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032140.549867:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857033984 00000100:00100000:2.0:1787032140.549876:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857033984 00000100:00100000:2.0:1787032140.549901:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857033728 00000100:00100000:2.0:1787032140.549904:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857033728 00000100:00100000:2.0:1787032140.549921:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787032140.549926:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857033984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.549955:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857033984:12345-0@lo:400:kworker.0 Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032140.549961:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787032140.549971:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787032140.549976:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857033728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.550001:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857033728:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032140.550006:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787032140.550028:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032140.550032:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032140.550034:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787032140.550085:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d5aa00 x1873838857033728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032140.550098:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857033728:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.550109:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857033600:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.550138:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857033472:0@lo:400:kworker.0 00010000:00080000:2.0:1787032140.550148:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d5b800 x1873838857033984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032140.550156:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857033984:0@lo:400:kworker.0 00000100:00100000:2.0:1787032140.550165:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857033856:0@lo:400:kworker.0 00000100:00100000:0.0:1787032140.550993:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857033344 00000100:00100000:0.0:1787032140.551000:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857033344 00000100:00100000:0.0:1787032140.551044:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787032140.551050:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857033344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032140.551120:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857033344:12345-0@lo:400:kworker.0 Request processed in 70us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032140.551126:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787032140.551276:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857033344:0@lo:400:kworker.0 00000100:00100000:3.0:1787032141.057959:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787032141.057985:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857034112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032141.058064:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032141.058105:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032141.058117:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857034240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032141.058153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032141.058250:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857034112 00000100:00100000:0.0:1787032141.058263:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857034112 00000100:00100000:0.0:1787032141.058317:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857034240 00000100:00100000:0.0:1787032141.058320:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857034240 00000100:00100000:0.0:1787032141.058335:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787032141.058343:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857034112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032141.058393:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032141.058446:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857034112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032141.058474:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787032141.058491:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca073800 x1873838857034112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032141.058498:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787032141.058510:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857034240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032141.058518:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857034112:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032141.058536:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032141.058580:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857034240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032141.058586:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787032141.058671:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c4e00 x1873838857034240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032141.058684:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857034240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787032141.444490:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032141.446193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032141.446237:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032141.446342:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834982912 00000100:00100000:1.0:1787032141.446350:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834982912 00000100:00100000:1.0:1787032141.446405:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 196 00000100:00100000:1.0:1787032141.446412:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2356:x1873838834982912:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032141.446470:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2356:x1873838834982912:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 59us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032141.446475:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 196 00000100:00100000:3.0:1787032141.446750:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834983040 00000100:00100000:3.0:1787032141.446754:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834983040 00000100:00100000:3.0:1787032141.446811:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:3.0:1787032141.446819:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834983040:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032141.446852:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834983040:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 35us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032141.446856:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00080000:1.0:1787032141.447144:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787032142.465310:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787032142.541721:0:9296:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.55.1 00010000:00010000:2.0:1787032143.490518:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032144.520177:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787032144.912867:0:9344:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Aug 18 01:49:02 EDT 2026 00010000:00010000:2.0:1787032145.542909:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032145.665892:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857034496:0@lo:400:kworker.0 00000100:00100000:1.0:1787032145.665964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032145.666032:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857035008:0@lo:400:kworker.0 00000100:00100000:1.0:1787032145.666055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032145.666100:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787032145.666106:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857034368:0@lo:400:kworker.0 00000100:00100000:1.0:1787032145.666131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032145.666147:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857034880:0@lo:400:kworker.0 00000100:00100000:1.0:1787032145.666176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032145.666291:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857034624:0@lo:400:kworker.0 00000100:00100000:3.0:1787032145.666327:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032145.666350:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032145.666355:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857034752:0@lo:400:kworker.0 00000100:00100000:3.0:1787032145.666374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032145.666484:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857034496 00000100:00100000:1.0:1787032145.666491:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857034496 00000100:00100000:1.0:1787032145.666535:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857034880 00000100:00100000:1.0:1787032145.666538:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857034880 00000100:00100000:1.0:1787032145.666557:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857034624 00000100:00100000:1.0:1787032145.666559:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857034624 00000100:00100000:1.0:1787032145.666573:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787032145.666582:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032145.666631:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857034496:12345-0@lo:400:kworker.0 Request processed in 49us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032145.666637:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787032145.666651:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787032145.666656:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857034880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032145.666675:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857034880:12345-0@lo:400:kworker.0 Request processed in 20us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032145.666681:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787032145.666689:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787032145.666693:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857034624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032145.666726:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857034624:12345-0@lo:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032145.666732:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787032145.666746:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032145.666772:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857034880:0@lo:400:kworker.0 00000100:00100000:1.0:1787032145.666782:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857034496:0@lo:400:kworker.0 00000100:00100000:3.0:1787032145.666854:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857034624:0@lo:400:kworker.0 00000100:00100000:2.0:1787032145.667108:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857035008 00000100:00100000:2.0:1787032145.667112:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857035008 00000100:00100000:2.0:1787032145.667150:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857034752 00000100:00100000:2.0:1787032145.667153:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857034752 00000100:00100000:2.0:1787032145.667169:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787032145.667174:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857035008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032145.667210:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857035008:12345-0@lo:400:kworker.0 Request processed in 36us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032145.667216:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787032145.667227:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787032145.667238:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857034752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032145.667267:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857034752:12345-0@lo:400:kworker.0 Request processed in 29us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032145.667272:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787032145.667287:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857034368 00000100:00100000:2.0:1787032145.667290:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857034368 00010000:00080000:3.0:1787032145.667433:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca071f80 x1873838857034752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032145.667445:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857034752:0@lo:400:kworker.0 00000100:00100000:2.0:1787032145.667540:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787032145.667550:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857034368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032145.667578:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857034368:12345-0@lo:400:kworker.0 Request processed in 31us (1446us total) trans 0 rc 0/0 00000100:00080000:1.0:1787032145.678843:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787032145.678871:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787032145.678926:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857034368:0@lo:400:kworker.0 00010000:00080000:1.0:1787032145.678948:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbea00 x1873838857035008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032145.678960:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857035008:0@lo:400:kworker.0 00000100:00100000:2.0:1787032145.679471:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787032146.179779:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857035136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032146.179860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032146.179916:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032146.179922:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857035264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032146.179944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032146.180054:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857035136 00000100:00100000:0.0:1787032146.180062:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857035136 00000100:00100000:0.0:1787032146.180117:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857035264 00000100:00100000:0.0:1787032146.180122:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857035264 00000100:00100000:0.0:1787032146.180135:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787032146.180154:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857035136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032146.180187:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032146.180232:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857035136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032146.180239:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787032146.180255:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787032146.180261:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857035264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032146.180279:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032146.184131:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857035264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3864us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032146.184154:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787032146.184228:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdffe08e00 x1873838857035264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032146.184253:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857035264:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787032146.184266:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbe300 x1873838857035136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032146.184277:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857035136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787032146.563122:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032146.563261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032146.563318:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032146.563349:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834983168 00000100:00100000:2.0:1787032146.563359:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834983168 00000100:00100000:2.0:1787032146.563405:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 198 00000100:00100000:2.0:1787032146.563414:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838834983168:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032146.563479:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838834983168:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032146.563487:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 198 00000100:00100000:1.0:1787032146.563703:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834983296 00000100:00100000:1.0:1787032146.563708:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834983296 00000100:00100000:1.0:1787032146.563776:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:1.0:1787032146.563793:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834983296:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032146.563835:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834983296:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 51us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032146.563842:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00080000:2.0:1787032146.564027:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787032147.620608:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032148.674512:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032149.697581:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032150.725386:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032150.785282:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857035648:0@lo:400:kworker.0 00000100:00100000:0.0:1787032150.785357:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032150.785414:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032150.785422:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857035776:0@lo:400:kworker.0 00000100:00100000:0.0:1787032150.785449:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032150.785489:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857035648 00000100:00100000:0.0:1787032150.785496:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857035648 00000100:00100000:0.0:1787032150.785552:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787032150.785562:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857035648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032150.785610:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857035648:12345-0@lo:400:kworker.0 Request processed in 51us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032150.785630:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787032150.785653:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857035776 00000100:00100000:0.0:1787032150.785657:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857035776 00000100:00100000:0.0:1787032150.785684:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787032150.785690:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857035776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032150.785729:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857035776:12345-0@lo:400:kworker.0 Request processed in 39us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032150.785734:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787032150.785750:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787032150.785754:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787032150.785783:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbf480 x1873838857035776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032150.785796:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857035776:0@lo:400:kworker.0 00000100:00100000:0.0:1787032150.785807:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857035648:0@lo:400:kworker.0 00000100:00100000:2.0:1787032150.785896:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857035392:0@lo:400:kworker.0 00000100:00100000:2.0:1787032150.785928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032150.785959:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857035904:0@lo:400:kworker.0 00000100:00100000:2.0:1787032150.785978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032150.786001:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787032150.786006:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857035520:0@lo:400:kworker.0 00000100:00100000:2.0:1787032150.786027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032150.786040:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857036032:0@lo:400:kworker.0 00000100:00100000:2.0:1787032150.786060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032150.786110:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857036032 00000100:00100000:2.0:1787032150.786114:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857036032 00000100:00100000:2.0:1787032150.786140:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787032150.786147:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857036032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032150.786178:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857036032:12345-0@lo:400:kworker.0 Request processed in 32us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032150.786183:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787032150.786204:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbf100 x1873838857036032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032150.786215:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857036032:0@lo:400:kworker.0 00000100:00100000:1.0:1787032150.786295:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857035904 00000100:00100000:1.0:1787032150.786299:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857035904 00000100:00100000:1.0:1787032150.786335:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857035520 00000100:00100000:1.0:1787032150.786338:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857035520 00000100:00100000:1.0:1787032150.786357:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787032150.786364:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857035904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032150.786402:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857035904:12345-0@lo:400:kworker.0 Request processed in 38us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032150.786408:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787032150.786423:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787032150.786429:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857035520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032150.786465:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857035520:12345-0@lo:400:kworker.0 Request processed in 36us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032150.786471:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787032150.786498:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857035520:0@lo:400:kworker.0 00000100:00100000:1.0:1787032150.786507:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857035904:0@lo:400:kworker.0 00000100:00100000:0.0:1787032150.786574:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857035392 00000100:00100000:0.0:1787032150.786578:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857035392 00000100:00100000:0.0:1787032150.786615:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787032150.786630:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857035392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032150.786665:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857035392:12345-0@lo:400:kworker.0 Request processed in 36us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032150.786670:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1787032150.786698:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032150.786701:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032150.786715:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857035392:0@lo:400:kworker.0 00000100:00100000:0.0:1787032151.297527:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787032151.297552:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857036160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032151.297630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032151.297703:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857036160 00000100:00100000:0.0:1787032151.297711:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857036160 00000100:00100000:0.0:1787032151.297757:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787032151.297766:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857036160:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032151.305911:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032151.305933:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857036288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032151.305997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032151.306051:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857036288 00000100:00100000:3.0:1787032151.306059:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857036288 00000100:00100000:3.0:1787032151.306126:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787032151.306134:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857036288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787032151.306168:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032151.306228:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857036288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032151.306236:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787032151.306278:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdffe09180 x1873838857036288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032151.306296:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857036288:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032151.311569:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032151.311689:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857036160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13920us (14055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032151.311699:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787032151.311817:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbe300 x1873838857036160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032151.311843:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857036160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032151.684388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032151.684445:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032151.684541:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834983552 00000100:00100000:2.0:1787032151.684551:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834983552 00000100:00100000:2.0:1787032151.684636:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00100000:2.0:1787032151.684647:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834983552:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032151.684736:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834983552:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032151.684744:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00080000:1.0:1787032151.685368:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032151.685775:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834983424 00000100:00100000:3.0:1787032151.685787:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834983424 00000100:00100000:3.0:1787032151.685856:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 200 00000100:00100000:3.0:1787032151.685866:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838834983424:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032151.685924:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838834983424:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 59us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032151.685931:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 200 00010000:00010000:2.0:1787032151.747955:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032152.776759:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032153.803190:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032154.823683:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032155.842291:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032155.912372:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857036672:0@lo:400:kworker.0 00000100:00100000:1.0:1787032155.912456:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032155.912509:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787032155.912516:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857036800:0@lo:400:kworker.0 00000100:00100000:1.0:1787032155.912552:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032155.912591:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857036672 00000100:00100000:1.0:1787032155.912599:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857036672 00000100:00100000:1.0:1787032155.912657:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787032155.912667:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857036672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032155.912718:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857036672:12345-0@lo:400:kworker.0 Request processed in 53us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032155.912726:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787032155.912750:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857036800 00000100:00100000:1.0:1787032155.912753:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857036800 00000100:00100000:1.0:1787032155.912797:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787032155.912804:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857036800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032155.912835:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857036800:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032155.912840:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787032155.912856:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787032155.912860:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787032155.912894:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c5f80 x1873838857036800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032155.912908:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857036800:0@lo:400:kworker.0 00000100:00100000:1.0:1787032155.912919:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857036672:0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913001:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857036416:0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032155.913081:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857036928:0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032155.913130:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787032155.913136:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857036544:0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032155.913171:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857037056:0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032155.913216:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857036928 00000100:00100000:2.0:1787032155.913219:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857036928 00000100:00100000:2.0:1787032155.913241:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857036544 00000100:00100000:2.0:1787032155.913244:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857036544 00000100:00100000:2.0:1787032155.913256:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787032155.913260:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857036928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913289:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857036928:12345-0@lo:400:kworker.0 Request processed in 29us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032155.913295:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787032155.913306:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787032155.913311:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857036544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913331:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857036544:12345-0@lo:400:kworker.0 Request processed in 20us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032155.913336:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787032155.913349:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857037056 00000100:00100000:2.0:1787032155.913352:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857037056 00000100:00100000:2.0:1787032155.913372:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787032155.913386:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857037056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913416:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857037056:12345-0@lo:400:kworker.0 Request processed in 32us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032155.913423:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787032155.913451:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857036544:0@lo:400:kworker.0 00010000:00080000:2.0:1787032155.913460:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c6300 x1873838857037056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032155.913469:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857037056:0@lo:400:kworker.0 00000100:00100000:2.0:1787032155.913477:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857036928:0@lo:400:kworker.0 00000100:00100000:1.0:1787032155.913676:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857036416 00000100:00100000:1.0:1787032155.913680:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857036416 00000100:00100000:1.0:1787032155.913716:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787032155.913721:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857036416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032155.913756:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857036416:12345-0@lo:400:kworker.0 Request processed in 35us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032155.913762:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1787032155.913790:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787032155.913793:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032155.913808:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857036416:0@lo:400:kworker.0 00000100:00100000:1.0:1787032156.417795:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857037184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032156.417864:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032156.418309:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857037184 00000100:00100000:3.0:1787032156.418317:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857037184 00000100:00100000:2.0:1787032156.418491:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857037312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032156.418536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032156.427322:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857037312 00000100:00100000:3.0:1787032156.427340:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857037312 00000100:00100000:3.0:1787032156.427420:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787032156.427433:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857037184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787032156.427476:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032156.427575:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857037184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (9710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032156.427583:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787032156.427600:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787032156.427606:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857037312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787032156.427637:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032156.427671:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857037312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (9134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032156.427677:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787032156.427863:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbf480 x1873838857037184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032156.427888:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857037184:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787032156.427928:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c4e00 x1873838857037312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032156.427940:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857037312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032156.808285:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032156.808325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032156.808582:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834983680 00000100:00100000:2.0:1787032156.808595:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834983680 00000100:00100000:2.0:1787032156.808653:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 202 00000100:00100000:2.0:1787032156.808664:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2356:x1873838834983680:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032156.808747:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2356:x1873838834983680:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 83us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032156.808763:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 202 00000100:00100000:3.0:1787032156.809127:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834983808 00000100:00100000:3.0:1787032156.809133:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834983808 00000100:00100000:3.0:1787032156.814265:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 56 00000100:00100000:3.0:1787032156.814284:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834983808:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032156.814386:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834983808:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 109us (6060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032156.814395:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 56 00000100:00080000:1.0:1787032156.815780:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787032156.865328:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032157.901281:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032158.916015:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032159.938332:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032160.961339:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032161.026021:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857037824:0@lo:400:kworker.0 00000100:00100000:0.0:1787032161.026122:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032161.026188:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787032161.026195:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857037696:0@lo:400:kworker.0 00000100:00100000:0.0:1787032161.026221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032161.026251:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857037824 00000100:00100000:0.0:1787032161.026259:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857037824 00000100:00100000:0.0:1787032161.026318:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787032161.026328:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857037824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032161.026380:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857037824:12345-0@lo:400:kworker.0 Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032161.026387:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787032161.026444:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbc380 x1873838857037824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032161.026458:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857037824:0@lo:400:kworker.0 00000100:00100000:1.0:1787032161.026583:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857037440:0@lo:400:kworker.0 00000100:00100000:1.0:1787032161.026620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032161.026799:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857037568:0@lo:400:kworker.0 00000100:00100000:3.0:1787032161.026829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032161.026861:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857038080:0@lo:400:kworker.0 00000100:00100000:3.0:1787032161.026901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032161.026948:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857038080 00000100:00100000:3.0:1787032161.026952:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857038080 00000100:00100000:3.0:1787032161.026980:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787032161.026986:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857038080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032161.027022:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857038080:12345-0@lo:400:kworker.0 Request processed in 36us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032161.027029:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787032161.027059:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbd180 x1873838857038080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032161.027087:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857038080:0@lo:400:kworker.0 00000100:00100000:3.0:1787032161.027119:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857037696 00000100:00100000:3.0:1787032161.027123:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857037696 00000100:00100000:3.0:1787032161.027148:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857037568 00000100:00100000:3.0:1787032161.027151:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857037568 00000100:00100000:3.0:1787032161.027169:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787032161.027176:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857037696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032161.027210:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857037696:12345-0@lo:400:kworker.0 Request processed in 34us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032161.027216:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787032161.027227:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787032161.027234:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857037568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032161.027262:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857037568:12345-0@lo:400:kworker.0 Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032161.027268:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787032161.027298:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857037568:0@lo:400:kworker.0 00000100:00100000:1.0:1787032161.028544:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857037952:0@lo:400:kworker.0 00000100:00100000:1.0:1787032161.028589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787032161.028623:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787032161.028638:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787032161.028641:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787032161.028929:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857037952 00000100:00100000:0.0:1787032161.028938:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857037952 00000100:00100000:0.0:1787032161.029001:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787032161.029009:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857037952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032161.029058:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857037952:12345-0@lo:400:kworker.0 Request processed in 50us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032161.029100:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787032161.029147:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857037696:0@lo:400:kworker.0 00000100:00080000:1.0:1787032161.029255:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032161.029276:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857037952:0@lo:400:kworker.0 00000100:00100000:2.0:1787032161.034622:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857037440 00000100:00100000:2.0:1787032161.034646:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857037440 00000100:00100000:2.0:1787032161.034716:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787032161.034726:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857037440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032161.034824:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857037440:12345-0@lo:400:kworker.0 Request processed in 99us (8202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032161.034832:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787032161.034949:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857037440:0@lo:400:kworker.0 00000100:00100000:2.0:1787032161.537445:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857038208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032161.537518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032161.537578:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032161.537585:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857038336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032161.537608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032161.537645:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857038208 00000100:00100000:2.0:1787032161.537652:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857038208 00000100:00100000:2.0:1787032161.537695:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857038336 00000100:00100000:2.0:1787032161.537698:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857038336 00000100:00100000:2.0:1787032161.537714:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787032161.537772:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857038208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032161.537809:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032161.537858:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857038208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032161.538120:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787032161.538131:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857038336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032161.538151:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032161.539025:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857038336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 892us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032161.539035:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787032161.539148:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc61c4e00 x1873838857038336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032161.539169:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857038336:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787032161.539198:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbdc00 x1873838857038208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032161.539209:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857038208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032161.539386:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787032161.928234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032161.928289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032161.928519:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834984064 00000100:00100000:3.0:1787032161.928531:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834984064 00000100:00100000:3.0:1787032161.928621:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:3.0:1787032161.928632:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834984064:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032161.928721:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834984064:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 90us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032161.928730:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00080000:1.0:1787032161.928957:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032161.929096:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834983936 00000100:00100000:2.0:1787032161.929102:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834983936 00000100:00100000:2.0:1787032161.929154:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 204 00000100:00100000:2.0:1787032161.929161:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2356:x1873838834983936:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032161.929209:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2356:x1873838834983936:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 48us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032161.929215:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 204 00010000:00010000:2.0:1787032161.986274:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032163.011342:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787032163.151653:0:9974:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:49:21 (1787032161) === 00000100:00100000:1.0:1787032163.594713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032163.594846:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834984192 00000100:00100000:3.0:1787032163.594860:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834984192 00000100:00100000:3.0:1787032163.594930:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 205 00000100:00100000:3.0:1787032163.594942:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:8098:x1873838834984192:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787032163.594963:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032163.594987:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1675400/0xcd047797ef1e98f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b26e2 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.595025:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1675400/0xcd047797ef1e98f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26e2 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.595402:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1675400/0xcd047797ef1e98f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26e2 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.595415:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1675400, rc 0) 00000100:00100000:3.0:1787032163.595486:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8098:x1873838834984192:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 546us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032163.595494:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 205 00000100:00100000:1.0:1787032163.601975:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032163.602101:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834984320 00000100:00100000:3.0:1787032163.602111:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834984320 00000100:00100000:3.0:1787032163.602184:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 206 00000100:00100000:3.0:1787032163.602194:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8098:x1873838834984320:12345-192.168.201.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787032163.602547:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8098:x1873838834984320:12345-192.168.201.48@tcp:501:mount.lustre.0 Request processed in 353us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032163.602556:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 206 00000100:00100000:2.0:1787032163.611273:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032163.613503:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834984448 00000100:00100000:3.0:1787032163.613521:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834984448 00000100:00100000:3.0:1787032163.613607:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 207 00000100:00100000:3.0:1787032163.613619:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8098:x1873838834984448:12345-192.168.201.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787032163.613889:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8098:x1873838834984448:12345-192.168.201.48@tcp:503:mount.lustre.0 Request processed in 271us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032163.613897:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 207 00000100:00100000:0.0:1787032163.617226:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032163.617326:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834984576 00000100:00100000:1.0:1787032163.617337:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834984576 00000100:00100000:1.0:1787032163.617405:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 208 00000100:00100000:1.0:1787032163.617416:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8102:x1873838834984576:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787032163.617720:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8102:x1873838834984576:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 305us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032163.617738:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 208 00000100:00100000:1.0:1787032163.648491:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032163.648633:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834984704 00000100:00100000:2.0:1787032163.648645:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834984704 00000100:00100000:2.0:1787032163.648710:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 209 00000100:00100000:2.0:1787032163.648721:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8102:x1873838834984704:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787032163.650529:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8102:x1873838834984704:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 1802us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032163.650541:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 209 00000100:00100000:2.0:1787032163.662426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032163.662521:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834984832 00000100:00100000:3.0:1787032163.662532:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834984832 00000100:00100000:3.0:1787032163.662588:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 210 00000100:00100000:3.0:1787032163.662599:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:8098:x1873838834984832:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787032163.662617:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032163.662637:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1674600/0xcd047797ef1e98fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b270c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.662668:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1674600/0xcd047797ef1e98fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b270c expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.662680:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1674600/0xcd047797ef1e98fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b270c expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.662691:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1674600, rc 0) 00000100:00100000:3.0:1787032163.662781:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:8098:x1873838834984832:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 184us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032163.662788:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 210 00000100:00100000:0.0:1787032163.669447:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032163.674020:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834984960 00000100:00100000:1.0:1787032163.674036:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834984960 00000100:00100000:1.0:1787032163.674145:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 211 00000100:00100000:1.0:1787032163.674156:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:8098:x1873838834984960:12345-192.168.201.48@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787032163.674187:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787032163.674215:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787032163.674220:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787032163.674223:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787032163.674225:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787032163.678602:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:8098:x1873838834984960:12345-192.168.201.48@tcp:256:mount.lustre.0 Request processed in 4433us (9153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032163.678618:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 211 00000100:00100000:2.0:1787032163.682809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032163.682963:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834985088 00000100:00100000:3.0:1787032163.682979:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834985088 00000100:00100000:3.0:1787032163.683050:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 212 00000100:00100000:3.0:1787032163.683059:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:8098:x1873838834985088:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787032163.683112:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032163.683132:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2713 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.683160:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.683171:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032163.683180:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1675000, rc 0) 00000100:00100000:3.0:1787032163.683242:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8098:x1873838834985088:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 183us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032163.683250:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 212 00000100:00100000:0.0:1787032163.695951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032163.698061:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834985216 00000100:00100000:2.0:1787032163.698124:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834985216 00000100:00100000:2.0:1787032163.698203:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 213 00000100:00100000:2.0:1787032163.698215:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8098:x1873838834985216:12345-192.168.201.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787032163.698569:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8098:x1873838834985216:12345-192.168.201.48@tcp:501:mount.lustre.0 Request processed in 354us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032163.698587:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 213 00000100:00100000:1.0:1787032163.702332:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032163.702559:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834985344 00000100:00100000:2.0:1787032163.702570:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834985344 00000100:00100000:2.0:1787032163.702635:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 214 00000100:00100000:2.0:1787032163.702646:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8098:x1873838834985344:12345-192.168.201.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787032163.703159:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8098:x1873838834985344:12345-192.168.201.48@tcp:503:mount.lustre.0 Request processed in 513us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032163.703169:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 214 00000100:00100000:0.0:1787032163.706795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032163.706889:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834985472 00000100:00100000:3.0:1787032163.706899:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834985472 00000100:00100000:3.0:1787032163.706959:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 215 00000100:00100000:3.0:1787032163.706977:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8105:x1873838834985472:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787032163.707276:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8105:x1873838834985472:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 307us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032163.707294:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 215 00000100:00100000:0.0:1787032163.713377:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032163.713516:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834985600 00000100:00100000:2.0:1787032163.713528:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834985600 00000100:00100000:2.0:1787032163.713639:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 216 00000100:00100000:2.0:1787032163.713650:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8105:x1873838834985600:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787032163.713944:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:8105:x1873838834985600:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 295us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032163.713953:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 216 00000100:00100000:0.0:1787032163.723575:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032163.723778:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834986112 00000100:00100000:3.0:1787032163.723790:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834986112 00000100:00100000:3.0:1787032163.723886:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00100000:3.0:1787032163.723897:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834986112:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032163.723996:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838834986112:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 100us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032163.724003:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00080000:1.0:1787032163.726960:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032163.728368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032163.728510:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834985728 00000100:00100000:3.0:1787032163.728520:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834985728 00000100:00100000:3.0:1787032163.728573:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:3.0:1787032163.728583:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1873838834985728:12345-192.168.201.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787032163.728617:0:5799:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from c0735b16-8786-4fbb-9d5e-05dc9dc09a65@192.168.201.48@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:3.0:1787032163.728661:0:5799:0:(genops.c:1406:class_connect()) connect: client c0735b16-8786-4fbb-9d5e-05dc9dc09a65, cookie 0xcd047797ef1e990a 00000004:00100000:3.0:1787032163.728692:0:5799:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787032163.728963:0:5799:0:(import.c:65:import_set_state_nolock()) ffff99cdc7784800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787032163.729057:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2353:x1873838834985728:12345-192.168.201.48@tcp:38:mount.lustre.0 Request processed in 473us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032163.729102:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:2.0:1787032163.736183:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032163.736221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032163.736305:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834985984 00000100:00100000:0.0:1787032163.736315:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834985984 00000100:00100000:0.0:1787032163.736415:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834985856 00000100:00100000:0.0:1787032163.736420:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834985856 00000100:00100000:0.0:1787032163.736446:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:0.0:1787032163.736456:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+7:8098:x1873838834985984:12345-192.168.201.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787032163.736501:0:7755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787032163.736584:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+7:8098:x1873838834985984:12345-192.168.201.48@tcp:41:mount.lustre.0 Request processed in 129us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032163.736591:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:0.0:1787032163.736608:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:0.0:1787032163.736614:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:0:x1873838834985856:12345-192.168.201.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787032163.736625:0:7755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787032163.736647:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:0:x1873838834985856:12345-192.168.201.48@tcp:41:mount.lustre.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032163.736653:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00080000:1.0:1787032163.736947:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032163.738130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032163.738216:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834986240 00000100:00100000:0.0:1787032163.738222:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834986240 00000100:00100000:0.0:1787032163.738274:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:0.0:1787032163.738283:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:8098:x1873838834986240:12345-192.168.201.48@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787032163.738354:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:8098:x1873838834986240:12345-192.168.201.48@tcp:40:mount.lustre.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032163.738362:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:0.0:1787032163.742464:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032163.742511:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032163.742632:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032163.742688:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834986624 00000100:00100000:1.0:1787032163.742698:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834986624 00000100:00100000:1.0:1787032163.742758:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:1.0:1787032163.742769:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:8098:x1873838834986624:12345-192.168.201.48@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787032163.743146:0:5800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787032163.743295:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:8098:x1873838834986624:12345-192.168.201.48@tcp:33:mount.lustre.0 Request processed in 527us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032163.743302:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:2.0:1787032163.745171:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834986368 00000100:00100000:2.0:1787032163.745186:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834986368 00000100:00100000:2.0:1787032163.745229:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834986496 00000100:00100000:2.0:1787032163.745233:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834986496 00000100:00100000:2.0:1787032163.745263:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:2.0:1787032163.745271:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1873838834986368:12345-192.168.201.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787032163.745298:0:6584:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c0735b16-8786-4fbb-9d5e-05dc9dc09a65@192.168.201.48@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1787032163.745337:0:6584:0:(genops.c:1406:class_connect()) connect: client c0735b16-8786-4fbb-9d5e-05dc9dc09a65, cookie 0xcd047797ef1e9911 00002000:00100000:2.0:1787032163.745358:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c0735b16-8786-4fbb-9d5e-05dc9dc09a65/ffff99cdf747c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787032163.745396:0:6584:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787032163.745627:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787032163.745659:0:6584:0:(import.c:65:import_set_state_nolock()) ffff99cdf747e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787032163.745733:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2353:x1873838834986368:12345-192.168.201.48@tcp:8:mount.lustre.0 Request processed in 460us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032163.745741:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:2.0:1787032163.745760:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:2.0:1787032163.745764:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1873838834986496:12345-192.168.201.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787032163.745781:0:6584:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c0735b16-8786-4fbb-9d5e-05dc9dc09a65@192.168.201.48@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1787032163.755524:0:6584:0:(genops.c:1406:class_connect()) connect: client c0735b16-8786-4fbb-9d5e-05dc9dc09a65, cookie 0xcd047797ef1e9918 00002000:00100000:2.0:1787032163.755551:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c0735b16-8786-4fbb-9d5e-05dc9dc09a65/ffff99cdf747f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787032163.755589:0:6584:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787032163.755874:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787032163.755918:0:6584:0:(import.c:65:import_set_state_nolock()) ffff99cdf7479000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787032163.757153:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2353:x1873838834986496:12345-192.168.201.48@tcp:8:mount.lustre.0 Request processed in 11378us (14511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032163.757166:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 14 00010000:00010000:2.0:1787032164.033386:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032165.059216:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787032165.204286:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00000001:00100000:2.0:1787032165.740641:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00010000:00010000:2.0:1787032166.085372:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032166.145660:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857038592:0@lo:400:kworker.0 00000100:00100000:3.0:1787032166.145747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032166.145832:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857039104:0@lo:400:kworker.0 00000100:00100000:3.0:1787032166.145859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032166.145903:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787032166.145909:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857038464:0@lo:400:kworker.0 00000100:00100000:0.0:1787032166.145981:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857038720:0@lo:400:kworker.0 00000100:00100000:1.0:1787032166.146056:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857038592 00000100:00100000:1.0:1787032166.146064:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857038592 00000100:00100000:1.0:1787032166.146131:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787032166.146139:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857038592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032166.146395:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857039104 00000100:00100000:2.0:1787032166.146400:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857039104 00000100:00100000:2.0:1787032166.146442:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787032166.146449:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857039104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032166.148815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032166.151205:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857038592:12345-0@lo:400:kworker.0 Request processed in 5056us (5448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032166.151221:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787032166.151259:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857038720 00000100:00100000:1.0:1787032166.151267:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857038720 00000100:00100000:1.0:1787032166.151315:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787032166.151325:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857038720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032166.151393:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857038720:12345-0@lo:400:kworker.0 Request processed in 70us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032166.151399:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787032166.152699:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857038720:0@lo:400:kworker.0 00000100:00100000:0.0:1787032166.152727:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032166.152739:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857038848:0@lo:400:kworker.0 00000100:00100000:0.0:1787032166.152791:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032166.157129:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857038848 00000100:00100000:1.0:1787032166.157146:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857038848 00000100:00100000:1.0:1787032166.157234:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787032166.157247:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857038848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032166.157354:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857038848:12345-0@lo:400:kworker.0 Request processed in 110us (4562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032166.157362:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787032166.160808:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca071f80 x1873838857038848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032166.160830:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857038848:0@lo:400:kworker.0 00000100:00080000:0.0:1787032166.161213:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787032166.161222:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032166.161225:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032166.163902:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857039104:12345-0@lo:400:kworker.0 Request processed in 17443us (18031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032166.163918:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787032166.173490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032166.173631:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857038976:0@lo:400:kworker.0 00000100:00100000:3.0:1787032166.173699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032166.173819:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857038464 00000100:00100000:2.0:1787032166.173827:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857038464 00000100:00100000:2.0:1787032166.173877:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787032166.173886:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857038464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032166.173894:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857038976 00000100:00100000:0.0:1787032166.173898:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857038976 00000100:00100000:0.0:1787032166.173949:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787032166.173956:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857038976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032166.173960:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857038464:12345-0@lo:400:kworker.0 Request processed in 76us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032166.173967:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787032166.173987:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857038976:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032166.173993:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787032166.174012:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787032166.174233:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca073480 x1873838857039104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032166.174248:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857039104:0@lo:400:kworker.0 00000100:00100000:3.0:1787032166.174260:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857038592:0@lo:400:kworker.0 00000100:00100000:3.0:1787032166.174282:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857038464:0@lo:400:kworker.0 00000100:00100000:3.0:1787032166.174291:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857038976:0@lo:400:kworker.0 00000100:00100000:0.0:1787032166.658249:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdefbd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857039360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032166.658337:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032166.658404:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787032166.658412:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857039232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032166.658421:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857039360 00000100:00100000:3.0:1787032166.658430:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857039360 00000100:00100000:0.0:1787032166.658438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032166.658482:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857039232 00000100:00100000:3.0:1787032166.658485:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857039232 00000100:00100000:3.0:1787032166.658501:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787032166.658510:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857039360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787032166.658547:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032166.658612:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857039360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032166.658615:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787032166.658625:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787032166.658630:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857039232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032166.658655:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032166.658699:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857039232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032166.658707:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787032166.658725:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfadbd500 x1873838857039232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032166.658764:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857039232:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787032166.658777:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdefbd1500 x1873838857039360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032166.658787:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdefbd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857039360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787032167.105304:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032168.129474:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787032168.837606:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00000100:00100000:0.0:1787032169.097302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032169.097348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032169.097378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032169.097421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032169.097517:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032169.097553:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834987264 00000100:00100000:0.0:1787032169.097565:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834987264 00000100:00100000:2.0:1787032169.097600:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834986752 00000100:00100000:2.0:1787032169.097606:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834986752 00000100:00100000:0.0:1787032169.097640:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834987136 00000100:00100000:0.0:1787032169.097645:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834987136 00000100:00100000:2.0:1787032169.097657:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 218 00000100:00100000:2.0:1787032169.097669:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2356:x1873838834986752:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032169.097680:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:0.0:1787032169.097691:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2356:x1873838834987264:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032169.097763:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2356:x1873838834987264:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 74us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032169.097771:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:0.0:1787032169.097790:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 38 00000100:00100000:0.0:1787032169.097796:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834987136:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032169.097925:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834986880 00000100:00100000:3.0:1787032169.097930:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834986880 00000100:00100000:2.0:1787032169.097938:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2356:x1873838834986752:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 270us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032169.097947:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 218 00000100:00100000:3.0:1787032169.097975:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834987008 00000100:00100000:3.0:1787032169.097980:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834987008 00000100:00100000:2.0:1787032169.097986:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 65 00000100:00100000:2.0:1787032169.098001:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834986880:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032169.098012:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 66 00000100:00100000:3.0:1787032169.098031:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2356:x1873838834987008:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032169.098033:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834986880:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 33us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032169.098043:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 65 00000100:00100000:3.0:1787032169.098090:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2356:x1873838834987008:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 62us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032169.098098:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 66 00000100:00100000:0.0:1787032169.107830:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834987136:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 10014us (10294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032169.107851:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 38 00000100:00080000:0.0:1787032169.107937:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032169.107946:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787032169.107949:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787032169.164427:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787032169.271511:0:10174:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787032170.178479:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032171.201329:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032171.268800:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857039872:0@lo:400:kworker.0 00000100:00100000:2.0:1787032171.268869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032171.268930:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787032171.268937:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857039744:0@lo:400:kworker.0 00000100:00100000:2.0:1787032171.268964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032171.268996:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857039872 00000100:00100000:2.0:1787032171.269004:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857039872 00000100:00100000:2.0:1787032171.269059:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787032171.269093:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857039872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032171.269147:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857039872:12345-0@lo:400:kworker.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032171.269153:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787032171.269177:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857039744 00000100:00100000:2.0:1787032171.269181:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857039744 00000100:00100000:2.0:1787032171.269205:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787032171.269226:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857039744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032171.269269:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857039744:12345-0@lo:400:kworker.0 Request processed in 58us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032171.269275:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787032171.269311:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857039744:0@lo:400:kworker.0 00010000:00080000:2.0:1787032171.269325:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d58700 x1873838857039872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032171.269347:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857039872:0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.269548:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfaf13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857039488:0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.269591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032171.269625:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857040000:0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.269645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032171.269666:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787032171.269672:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfaf13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857039616:0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.269698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032171.269716:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857040128:0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.269753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032171.269780:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857040000 00000100:00100000:1.0:1787032171.269783:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857040000 00000100:00100000:1.0:1787032171.269810:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857039616 00000100:00100000:1.0:1787032171.269813:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857039616 00000100:00100000:1.0:1787032171.269826:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787032171.269832:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857040000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.269866:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857040000:12345-0@lo:400:kworker.0 Request processed in 34us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032171.269872:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787032171.269885:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787032171.269890:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857039616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.269915:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857039616:12345-0@lo:400:kworker.0 Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032171.269921:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787032171.269940:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857040128 00000100:00100000:1.0:1787032171.269944:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857040128 00000100:00100000:1.0:1787032171.269967:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787032171.269973:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857040128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.270002:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857040128:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032171.270008:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787032171.270193:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfaf13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857039616:0@lo:400:kworker.0 00010000:00080000:1.0:1787032171.270204:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d59f80 x1873838857040128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032171.270228:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857040128:0@lo:400:kworker.0 00000100:00100000:1.0:1787032171.270260:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857040000:0@lo:400:kworker.0 00000100:00100000:2.0:1787032171.272169:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857039488 00000100:00100000:2.0:1787032171.272182:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857039488 00000100:00100000:2.0:1787032171.272266:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787032171.272275:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857039488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032171.272361:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857039488:12345-0@lo:400:kworker.0 Request processed in 87us (2770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032171.272368:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787032171.273403:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfaf13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857039488:0@lo:400:kworker.0 00000100:00080000:0.0:1787032171.277557:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032171.277567:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032171.277570:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032171.781880:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857040384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032171.781954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032171.782020:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787032171.782027:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857040256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032171.782051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032171.782110:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857040384 00000100:00100000:2.0:1787032171.782118:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857040384 00000100:00100000:2.0:1787032171.782161:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857040256 00000100:00100000:2.0:1787032171.782164:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857040256 00000100:00100000:2.0:1787032171.782179:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787032171.782187:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857040384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032171.782223:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032171.782284:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857040384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032171.782292:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787032171.782308:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787032171.782314:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857040256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032171.782342:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032171.782371:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857040256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032171.782376:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787032171.782414:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4870a80 x1873838857040256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032171.782436:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857040256:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787032171.782448:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d58700 x1873838857040384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032171.782459:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857040384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787032172.225845:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032173.252165:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032174.223776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032174.223829:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032174.223854:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032174.223878:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032174.223902:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032174.224128:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834987392 00000100:00100000:2.0:1787032174.224140:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834987392 00000100:00100000:2.0:1787032174.224212:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 220 00000100:00100000:2.0:1787032174.224223:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834987392:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032174.224303:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834987392:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 82us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032174.224311:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 220 00000100:00100000:2.0:1787032174.224343:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834987904 00000100:00100000:2.0:1787032174.224346:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834987904 00000100:00100000:2.0:1787032174.224382:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834987776 00000100:00100000:2.0:1787032174.224385:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834987776 00000100:00100000:2.0:1787032174.224404:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:2.0:1787032174.224409:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834987904:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032174.224456:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834987904:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 46us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032174.224462:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:2.0:1787032174.224474:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:2.0:1787032174.224480:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834987776:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032174.224504:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834987776:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032174.224510:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00080000:2.0:1787032174.224646:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032174.224651:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787032174.224951:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834987648 00000100:00100000:1.0:1787032174.224957:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834987648 00000100:00100000:1.0:1787032174.224991:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834987520 00000100:00100000:1.0:1787032174.224995:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834987520 00000100:00100000:1.0:1787032174.225020:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 70 00000100:00100000:1.0:1787032174.225026:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834987648:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032174.225091:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834987648:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 64us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032174.225098:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 70 00000100:00100000:1.0:1787032174.225112:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 71 00000100:00100000:1.0:1787032174.225118:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834987520:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032174.225143:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834987520:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 26us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032174.225150:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 71 00000100:00080000:2.0:1787032174.226352:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787032174.273950:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032175.297737:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032176.321631:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032176.385390:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857040896:0@lo:400:kworker.0 00000100:00100000:2.0:1787032176.385494:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032176.385562:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787032176.385569:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857040768:0@lo:400:kworker.0 00000100:00100000:2.0:1787032176.385712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032176.385751:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857040896 00000100:00100000:2.0:1787032176.385758:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857040896 00000100:00100000:2.0:1787032176.385812:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032176.385821:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857040896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032176.385873:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857040896:12345-0@lo:400:kworker.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032176.385880:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032176.385903:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857040768 00000100:00100000:2.0:1787032176.385906:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857040768 00000100:00100000:2.0:1787032176.385941:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787032176.385946:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857040768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032176.385973:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873838857040768:12345-0@lo:400:kworker.0 Request processed in 28us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032176.385979:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787032176.385993:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787032176.385998:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032176.386025:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1873838857040768:0@lo:400:kworker.0 00010000:00080000:2.0:1787032176.386037:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d58000 x1873838857040896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032176.386046:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857040896:0@lo:400:kworker.0 00000100:00100000:3.0:1787032176.386307:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857040640:0@lo:400:kworker.0 00000100:00100000:3.0:1787032176.386342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032176.386378:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857041152:0@lo:400:kworker.0 00000100:00100000:3.0:1787032176.386400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032176.386428:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787032176.386434:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857040512:0@lo:400:kworker.0 00000100:00100000:3.0:1787032176.386471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032176.386491:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857041024:0@lo:400:kworker.0 00000100:00100000:3.0:1787032176.386511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032176.386536:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857041152 00000100:00100000:3.0:1787032176.386540:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857041152 00000100:00100000:3.0:1787032176.386573:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787032176.386580:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857041152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032176.386827:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857041152:12345-0@lo:400:kworker.0 Request processed in 247us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032176.386846:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787032176.386869:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857040512 00000100:00100000:3.0:1787032176.386872:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857040512 00000100:00100000:3.0:1787032176.386895:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787032176.386901:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857040512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032176.386928:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857040512:12345-0@lo:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032176.386934:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1787032176.386957:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032176.386974:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857040512:0@lo:400:kworker.0 00010000:00080000:3.0:1787032176.386985:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d59880 x1873838857041152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032176.386995:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857041152:0@lo:400:kworker.0 00000100:00100000:2.0:1787032176.387131:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857040640 00000100:00100000:2.0:1787032176.387136:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857040640 00000100:00100000:2.0:1787032176.387175:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857041024 00000100:00100000:2.0:1787032176.387178:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857041024 00000100:00100000:2.0:1787032176.387245:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787032176.387251:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857040640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032176.387297:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857040640:12345-0@lo:400:kworker.0 Request processed in 34us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032176.387303:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787032176.387314:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787032176.387319:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857041024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032176.387343:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857041024:12345-0@lo:400:kworker.0 Request processed in 24us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032176.387348:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787032176.388276:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857041024:0@lo:400:kworker.0 00000100:00100000:3.0:1787032176.388303:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857040640:0@lo:400:kworker.0 00000100:00080000:0.0:1787032176.395922:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032176.899573:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857041280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032176.899658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032176.912248:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857041408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032176.912342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032176.912425:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857041280 00000100:00100000:2.0:1787032176.912433:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857041280 00000100:00100000:0.0:1787032176.912460:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857041408 00000100:00100000:0.0:1787032176.912463:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857041408 00000100:00100000:2.0:1787032176.912607:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787032176.912617:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857041280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032176.912660:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032176.912708:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857041280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (13048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032176.912714:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787032176.916723:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787032176.916741:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857041408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032176.916780:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032176.916873:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857041408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032176.916881:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787032176.920256:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4873100 x1873838857041408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032176.920283:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857041408:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787032176.921173:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef891500 x1873838857041280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032176.921191:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857041280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787032177.349233:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032178.374690:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032179.337585:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032179.337626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032179.337655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032179.338167:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834988032 00000100:00100000:3.0:1787032179.338194:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834988032 00000100:00100000:3.0:1787032179.338260:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 222 00000100:00100000:3.0:1787032179.338269:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834988032:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032179.338340:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834988032:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 71us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032179.338347:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 222 00000100:00100000:1.0:1787032179.339697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032179.340355:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834988544 00000100:00100000:3.0:1787032179.340363:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834988544 00000100:00100000:3.0:1787032179.340429:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:3.0:1787032179.340439:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834988544:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032179.340499:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834988544:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 63us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032179.340506:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00080000:1.0:1787032179.340618:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032179.341558:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834988160 00000100:00100000:0.0:1787032179.341566:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834988160 00000100:00100000:2.0:1787032179.341707:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834988288 00000100:00100000:2.0:1787032179.341712:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834988288 00000100:00080000:0.0:1787032179.341816:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032179.341970:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00100000:2.0:1787032179.341981:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834988288:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032179.342055:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834988288:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 77us (4398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032179.342062:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00100000:3.0:1787032179.342613:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 76 00000100:00100000:3.0:1787032179.342624:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2354:x1873838834988160:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032179.342671:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2354:x1873838834988160:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 49us (5044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032179.342677:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 76 00000100:00080000:0.0:1787032179.342818:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032179.343674:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032179.343780:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834988416 00000100:00100000:0.0:1787032179.343788:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834988416 00000100:00100000:0.0:1787032179.343829:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:0.0:1787032179.343837:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838834988416:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032179.343882:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838834988416:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 46us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032179.343889:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00080000:0.0:1787032179.343908:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787032179.395932:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032180.417355:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032181.445592:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032181.505392:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857041536:0@lo:400:kworker.0 00000100:00100000:1.0:1787032181.505460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032181.505652:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857041664:0@lo:400:kworker.0 00000100:00100000:1.0:1787032181.505687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032181.505863:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857041536 00000100:00100000:3.0:1787032181.505871:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857041536 00000100:00100000:1.0:1787032181.505889:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787032181.505900:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857042048:0@lo:400:kworker.0 00000100:00100000:3.0:1787032181.505925:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787032181.505930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032181.505938:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032181.505966:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857041664 00000100:00100000:1.0:1787032181.505971:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857041664 00000100:00100000:1.0:1787032181.506002:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857042048 00000100:00100000:1.0:1787032181.506005:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857042048 00000100:00100000:1.0:1787032181.506032:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787032181.506039:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857041664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032181.506112:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857041664:12345-0@lo:400:kworker.0 Request processed in 73us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032181.506119:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787032181.506135:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787032181.506141:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857042048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032181.506180:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857042048:12345-0@lo:400:kworker.0 Request processed in 40us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032181.506202:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787032181.506226:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032181.506262:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857042048:0@lo:400:kworker.0 00000100:00100000:1.0:1787032181.506272:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857041664:0@lo:400:kworker.0 00000100:00100000:3.0:1787032181.506734:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857041536:12345-0@lo:400:kworker.0 Request processed in 798us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032181.506743:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787032181.506783:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857041792:0@lo:400:kworker.0 00000100:00100000:1.0:1787032181.506805:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857042176:0@lo:400:kworker.0 00000100:00100000:3.0:1787032181.506812:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032181.506840:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787032181.506845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032181.506849:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857041920:0@lo:400:kworker.0 00000100:00100000:3.0:1787032181.506879:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032181.506922:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857042176 00000100:00100000:3.0:1787032181.506926:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857042176 00000100:00080000:1.0:1787032181.506953:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032181.507034:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857041920 00000100:00100000:3.0:1787032181.507039:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787032181.507041:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857041920 00000100:00100000:3.0:1787032181.507049:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857042176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032181.507125:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857042176:12345-0@lo:400:kworker.0 Request processed in 78us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032181.507133:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787032181.507181:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857041536:0@lo:400:kworker.0 00000100:00100000:3.0:1787032181.507200:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857041792 00000100:00100000:3.0:1787032181.507203:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857041792 00000100:00100000:0.0:1787032181.507286:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787032181.507294:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857041920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032181.507338:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857041920:12345-0@lo:400:kworker.0 Request processed in 45us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032181.507355:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787032181.507554:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787032181.507558:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032181.507580:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787032181.507588:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857041792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032181.507621:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857041792:12345-0@lo:400:kworker.0 Request processed in 34us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032181.508035:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1787032181.508101:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4871c00 x1873838857041920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032181.508115:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857041920:0@lo:400:kworker.0 00000100:00100000:3.0:1787032181.508126:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857041792:0@lo:400:kworker.0 00010000:00080000:3.0:1787032181.508156:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4871f80 x1873838857042176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032181.508173:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857042176:0@lo:400:kworker.0 00000100:00100000:2.0:1787032182.018181:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787032182.018205:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857042304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032182.018234:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032182.018245:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857042432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032182.018281:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032182.018352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032182.018424:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857042432 00000100:00100000:1.0:1787032182.018433:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857042432 00000100:00100000:1.0:1787032182.018483:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857042304 00000100:00100000:1.0:1787032182.018495:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857042304 00000100:00100000:1.0:1787032182.018513:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787032182.018521:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857042432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032182.018557:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032182.018605:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857042432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032182.018612:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787032182.018628:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787032182.018633:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857042304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787032182.018778:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032182.018817:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857042304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032182.018823:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787032182.018869:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdca071f80 x1873838857042432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032182.018887:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857042432:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787032182.019004:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef890380 x1873838857042304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032182.019029:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857042304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787032182.467871:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032183.490256:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032184.454128:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032184.454185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032184.454217:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032184.454243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032184.454270:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032184.454303:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834988928 00000100:00100000:1.0:1787032184.454317:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834988928 00000100:00100000:2.0:1787032184.454339:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834988800 00000100:00100000:2.0:1787032184.454344:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834988800 00000100:00100000:3.0:1787032184.454774:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834988672 00000100:00100000:3.0:1787032184.454780:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834988672 00000100:00100000:1.0:1787032184.454938:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 80 00000100:00100000:1.0:1787032184.454949:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838834988928:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032184.455055:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838834988928:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 107us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032184.455063:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 80 00000100:00100000:1.0:1787032184.455116:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834989056 00000100:00100000:1.0:1787032184.455120:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834989056 00000100:00100000:2.0:1787032184.455838:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 81 00000100:00100000:2.0:1787032184.455849:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2354:x1873838834988800:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032184.455876:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834989184 00000100:00100000:1.0:1787032184.455880:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834989184 00000100:00100000:2.0:1787032184.455900:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2354:x1873838834988800:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 53us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032184.455907:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 81 00000100:00100000:1.0:1787032184.455907:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:1.0:1787032184.455913:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2353:x1873838834989056:12345-192.168.201.48@tcp:9:kworker.0 00000020:00000080:1.0:1787032184.455938:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9911 00000100:00080000:1.0:1787032184.455949:0:6586:0:(import.c:65:import_set_state_nolock()) ffff99cdf747e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787032184.456012:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1787032184.456211:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032184.456216:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787032184.456219:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032184.456234:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:0.0:1787032184.456242:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2353:x1873838834989184:12345-192.168.201.48@tcp:9:kworker.0 00000020:00000080:0.0:1787032184.456269:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9918 00000100:00080000:0.0:1787032184.456275:0:6587:0:(import.c:65:import_set_state_nolock()) ffff99cdf7479000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787032184.456304:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787032184.456922:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+2:2353:x1873838834989056:12345-192.168.201.48@tcp:9:kworker.0 Request processed in 1004us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032184.456953:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 15 00010000:00010000:1.0:1787032184.456997:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032184.459129:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+2:2353:x1873838834989184:12345-192.168.201.48@tcp:9:kworker.0 Request processed in 2873us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032184.459146:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:2.0:1787032184.459215:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 224 00000100:00100000:2.0:1787032184.459239:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838834988672:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032184.459820:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838834988672:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 589us (5704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032184.459831:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 224 00010000:00010000:0.0:1787032184.460268:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032184.515138:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032185.537330:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787032185.688315:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00000020:00000080:0.0:1787032185.688330:0:7500:0:(genops.c:906:class_export_put()) final put ffff99cdf747f000/c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00000020:00000080:1.0:1787032185.688675:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdf747f000/c0735b16-8786-4fbb-9d5e-05dc9dc09a65 for lustre-OST0001 00000020:00000080:1.0:1787032185.688814:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdf7479000 for lustre-OST0001 00010000:00010000:1.0:1787032186.561301:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032186.631000:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857042688:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032186.631147:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857043200:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032186.631206:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787032186.631211:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857042560:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032186.631255:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857043072:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032186.631300:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857042816:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631321:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032186.631338:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032186.631343:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857042944:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032186.631396:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857042688 00000100:00100000:3.0:1787032186.631404:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857042688 00000100:00100000:3.0:1787032186.631445:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857043072 00000100:00100000:3.0:1787032186.631448:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857043072 00000100:00100000:3.0:1787032186.631468:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857042816 00000100:00100000:3.0:1787032186.631476:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857042816 00000100:00100000:3.0:1787032186.631498:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787032186.631506:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857042688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631559:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857042688:12345-0@lo:400:kworker.0 Request processed in 54us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032186.631567:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787032186.631583:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787032186.631589:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857043072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631615:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857043072:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032186.631621:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787032186.631630:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787032186.631635:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857042816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631663:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857042816:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032186.631669:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787032186.631685:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857043200 00000100:00100000:3.0:1787032186.631688:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857043200 00000100:00100000:3.0:1787032186.631712:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857042944 00000100:00100000:3.0:1787032186.631715:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857042944 00000100:00100000:3.0:1787032186.631733:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787032186.631739:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857043200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631766:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857043200:12345-0@lo:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032186.631772:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787032186.631782:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787032186.631787:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857042944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631820:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857042944:12345-0@lo:400:kworker.0 Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032186.631826:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787032186.631844:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857042560 00000100:00100000:3.0:1787032186.631847:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857042560 00000100:00100000:3.0:1787032186.631871:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787032186.631877:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857042560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.631906:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857042560:12345-0@lo:400:kworker.0 Request processed in 29us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032186.631912:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1787032186.631950:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787032186.631954:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787032186.631957:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787032186.632007:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef003800 x1873838857042944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032186.632021:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857042944:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.632033:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857042816:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.632063:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857042560:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.632100:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857043072:0@lo:400:kworker.0 00000100:00100000:3.0:1787032186.632109:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857042688:0@lo:400:kworker.0 00010000:00080000:3.0:1787032186.632117:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef001500 x1873838857043200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032186.632126:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857043200:0@lo:400:kworker.0 00000001:02000400:2.0:1787032186.817179:0:10878:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787032187.137356:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857043328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032187.137450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032187.137640:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857043328 00000100:00100000:2.0:1787032187.137649:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857043328 00000100:00100000:2.0:1787032187.137703:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787032187.137714:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857043328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032187.137752:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032187.137804:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857043328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032187.137812:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787032187.137854:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef890380 x1873838857043328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032187.137885:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857043328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032187.138314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032187.138324:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857043456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032187.138353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032187.138484:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857043456 00000100:00100000:0.0:1787032187.138489:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857043456 00000100:00100000:0.0:1787032187.138523:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787032187.138531:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857043456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032187.138554:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032187.138588:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857043456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032187.138594:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787032187.138683:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4870700 x1873838857043456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032187.138696:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857043456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787032187.585320:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032188.609521:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787032189.280211:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00000020:00000080:0.0:1787032189.280221:0:6614:0:(genops.c:906:class_export_put()) final put ffff99cdf747c800/c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00000020:00000080:3.0:1787032189.280291:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdf747c800/c0735b16-8786-4fbb-9d5e-05dc9dc09a65 for lustre-OST0000 00000020:00000080:3.0:1787032189.280340:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdf747e000 for lustre-OST0000 00000100:00100000:3.0:1787032189.577088:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032189.577119:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032189.577155:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032189.577188:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834989312 00000100:00100000:3.0:1787032189.577199:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834989312 00000100:00100000:3.0:1787032189.577263:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 226 00000100:00100000:3.0:1787032189.577274:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834989312:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032189.577355:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834989312:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032189.577363:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 226 00000100:00100000:3.0:1787032189.577404:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834989568 00000100:00100000:3.0:1787032189.577407:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834989568 00000100:00100000:3.0:1787032189.577443:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834989440 00000100:00100000:3.0:1787032189.577445:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834989440 00000100:00100000:3.0:1787032189.577464:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 85 00000100:00100000:3.0:1787032189.577470:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834989568:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032189.577501:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834989568:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032189.577508:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 85 00000100:00100000:3.0:1787032189.577518:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00100000:3.0:1787032189.577525:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834989440:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032189.577549:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834989440:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032189.578144:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00080000:3.0:1787032189.578171:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787032189.641988:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032190.658145:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787032191.561227:0:11029:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3c1e1d90 20000000:00000080:2.0:1787032191.561251:0:11029:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cdfb20e000 uarg=0000000000000000 20000000:01000000:2.0:1787032191.561310:0:11029:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787032191.561390:0:11029:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787032191.561397:0:11029:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787032191.563612:0:11030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787032191.570206:0:11029:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787032191.577448:0:11029:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787032191.581864:0:11029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.581913:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.581924:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.581932:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.581939:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.581960:0:11029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.581969:0:11029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.582026:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.582045:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 12 pid: 5792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032191.582064:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857043584:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032191.582247:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.582257:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 18 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032191.582267:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857043712:0@lo:104: 00000100:00100000:2.0:1787032191.583142:0:11029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787032191.583328:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032191.583343:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 18 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032191.583355:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857043840:0@lo:104: 00000100:00100000:3.0:1787032191.583397:0:11029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787032191.583435:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032191.583444:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 18 pid: 5791 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032191.583452:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef000700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857043968:0@lo:104: 00000100:00100000:3.0:1787032191.583474:0:11029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787032191.583509:0:11029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032191.583519:0:11029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 12 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032191.583529:0:11029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef002300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857044096:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032191.583662:0:11029:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc892f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787032191.583743:0:7488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857043712 00000100:00100000:1.0:1787032191.583753:0:7488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857043712 00000100:00100000:1.0:1787032191.583811:0:7488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857043840 00000100:00100000:1.0:1787032191.583814:0:7488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857043840 00000100:00100000:1.0:1787032191.583822:0:7488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857043968 00000100:00100000:1.0:1787032191.583824:0:7488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857043968 00000100:00100000:1.0:1787032191.583838:0:7488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787032191.583847:0:7488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0402f217-6678-4505-97bf-ca0cb32c7313+5:11029:x1873838857043712:12345-0@lo:104: 00010000:00010000:1.0:1787032191.583864:0:7488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.583959:0:7488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787032191.583966:0:7488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0402f217-6678-4505-97bf-ca0cb32c7313+5:11029:x1873838857043712:12345-0@lo:104: Request processed in 120us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032191.583975:0:7488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787032191.583998:0:7488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787032191.584004:0:7488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef003800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0402f217-6678-4505-97bf-ca0cb32c7313+4:11029:x1873838857043840:12345-0@lo:104: 00010000:00010000:1.0:1787032191.584012:0:7488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584063:0:7488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787032191.584106:0:7488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef003800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0402f217-6678-4505-97bf-ca0cb32c7313+4:11029:x1873838857043840:12345-0@lo:104: Request processed in 103us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032191.584113:0:7488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787032191.584126:0:7488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787032191.584132:0:7488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0402f217-6678-4505-97bf-ca0cb32c7313+3:11029:x1873838857043968:12345-0@lo:104: 00010000:00010000:1.0:1787032191.584140:0:7488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584166:0:7488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787032191.584170:0:7488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0402f217-6678-4505-97bf-ca0cb32c7313+3:11029:x1873838857043968:12345-0@lo:104: Request processed in 40us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032191.584176:0:7488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787032191.584194:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787032191.584203:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584212:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032191.584217:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584227:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032191.584237:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032191.584244:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787032191.584294:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584300:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032191.584328:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584335:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1e98e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98ee expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584352:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787032191.584356:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584362:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032191.584365:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584371:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032191.584377:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032191.584382:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787032191.584396:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584402:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032191.584408:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584424:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6800/0xcd047797ef1e98d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98e0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584434:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032191.584437:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584444:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1674c00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032191.584447:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584453:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032191.584459:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032191.584464:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787032191.584478:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584484:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032191.584502:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584508:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1674c00/0xcd047797ef1e98cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e98d2 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584524:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032191.584532:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032191.584533:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032191.584541:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032191.584567:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857044224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032191.584611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032191.584638:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032191.584644:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857044352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032191.584666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032191.584695:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857044480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032191.584720:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032191.584756:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857044224 00000100:00100000:1.0:1787032191.584762:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857044224 00010000:00010000:1.0:1787032191.584785:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 19 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032191.584803:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857044352 00000100:00100000:1.0:1787032191.584806:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857044352 00010000:00010000:1.0:1787032191.584817:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 20 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032191.584827:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857044480 00000100:00100000:1.0:1787032191.584830:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857044480 00010000:00010000:1.0:1787032191.584838:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 21 pid: 5791 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032191.584849:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787032191.584854:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+21:3304:x1873838857044224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787032191.584868:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032191.584887:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 21 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584904:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 21 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.584924:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032191.584953:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+21:3304:x1873838857044224:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032191.584961:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787032191.585008:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787032191.585013:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+20:3304:x1873838857044352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787032191.585021:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032191.585025:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 20 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.585032:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 20 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.585041:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032191.585063:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+20:3304:x1873838857044352:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032191.585098:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787032191.585109:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787032191.585115:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857044480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787032191.585122:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032191.585125:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 19 pid: 5791 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.585133:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 19 pid: 5791 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032191.585148:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032191.585174:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857044480:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032191.585181:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787032191.585225:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857044480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032191.585257:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857044352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032191.585270:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857044224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032191.585861:0:11029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6c00/0xcd047797ef1e98ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e98e7 expref: 18 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032191.585905:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857043712:0@lo:104: 00010000:00010000:3.0:1787032191.585922:0:11029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6400/0xcd047797ef1e98e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e98d9 expref: 17 pid: 5790 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032191.585929:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857043840:0@lo:104: 00010000:00010000:3.0:1787032191.585937:0:11029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1e98d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e98cb expref: 16 pid: 5791 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032191.585944:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef000700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857043968:0@lo:104: 00000100:00100000:1.0:1787032191.588181:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032191.588359:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834989696 00000100:00100000:2.0:1787032191.588370:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834989696 00010000:00010000:2.0:1787032191.588421:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 13 pid: 5792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032191.588470:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:2.0:1787032191.588482:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834989696:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032191.588520:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032191.588528:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 13 pid: 5792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.588542:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 13 pid: 5792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.588571:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032191.588638:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834989696:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 159us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032191.588647:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 28 00010000:00010000:3.0:1787032191.589003:0:11029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1675000/0xcd047797ef1e9903 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2713 expref: 12 pid: 5792 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032191.589022:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857043584:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032191.589034:0:11029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef002300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11029:1873838857044096:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032191.589102:0:11029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032191.590381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032191.590477:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834989824 00000100:00100000:0.0:1787032191.590486:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834989824 00010000:00010000:0.0:1787032191.590536:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 12 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032191.590577:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:0.0:1787032191.590588:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:2354:x1873838834989824:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032191.590603:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032191.590610:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 12 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590624:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 12 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590642:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0031400/0xcd047797ef1e98c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26db expref: 12 pid: 5790 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590663:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590674:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590692:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590719:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590728:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590736:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590742:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032191.590747:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590756:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590777:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032191.590787:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032191.590843:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:2354:x1873838834989824:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 257us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032191.590850:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 29 00010000:00010000:3.0:1787032191.591267:0:11029:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032191.591278:0:11029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032191.591285:0:11029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e991f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032191.692703:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032191.745379:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857044992:0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.745480:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032191.745554:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787032191.745562:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857044608:0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.745588:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032191.745606:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857045120:0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.745632:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032191.745658:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857044736:0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.745682:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032191.745699:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787032191.745703:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857044864:0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.745723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032191.745755:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857044992 00000100:00100000:3.0:1787032191.745764:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857044992 00000100:00100000:3.0:1787032191.745823:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857044608 00000100:00100000:3.0:1787032191.745826:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857044608 00000100:00100000:3.0:1787032191.745841:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857044736 00000100:00100000:3.0:1787032191.745843:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857044736 00000100:00100000:3.0:1787032191.745858:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787032191.745866:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857044992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.745935:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857044992:12345-0@lo:400:kworker.0 Request processed in 70us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032191.745943:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787032191.745960:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787032191.745966:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857044608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.746010:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857044608:12345-0@lo:400:kworker.0 Request processed in 45us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032191.746015:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787032191.746026:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787032191.746032:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857044736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.746058:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857044736:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032191.746064:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787032191.746124:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857045120 00000100:00100000:3.0:1787032191.746127:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857045120 00000100:00100000:3.0:1787032191.746153:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857044864 00000100:00100000:3.0:1787032191.746156:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857044864 00000100:00100000:3.0:1787032191.746176:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787032191.746182:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857045120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.746215:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857045120:12345-0@lo:400:kworker.0 Request processed in 33us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032191.746220:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787032191.746231:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787032191.746236:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857044864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.746264:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857044864:12345-0@lo:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032191.746269:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787032191.746295:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787032191.746300:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787032191.746303:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787032191.746347:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef001880 x1873838857044864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032191.746377:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857044864:0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.746391:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857044736:0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.746432:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857044608:0@lo:400:kworker.0 00010000:00080000:3.0:1787032191.746443:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef002680 x1873838857045120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032191.746451:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857045120:0@lo:400:kworker.0 00000100:00100000:3.0:1787032191.746460:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857044992:0@lo:400:kworker.0 00000100:00100000:3.0:1787032192.257694:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857045248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032192.257797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032192.257915:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787032192.257923:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857045376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032192.257963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032192.258111:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857045248 00000100:00100000:0.0:1787032192.258123:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857045248 00000100:00100000:0.0:1787032192.258191:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857045376 00000100:00100000:0.0:1787032192.258195:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857045376 00000100:00100000:0.0:1787032192.258215:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787032192.258225:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857045248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032192.258295:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032192.258361:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857045248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032192.258370:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787032192.258393:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787032192.258399:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857045376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032192.258422:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032192.258450:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857045376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032192.258456:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787032192.258796:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4872a00 x1873838857045376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032192.258820:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857045376:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787032192.258833:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef892300 x1873838857045248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032192.258906:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857045248:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787032192.709490:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032192.816560:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032192.816705:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834989952 00000100:00100000:3.0:1787032192.816719:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834989952 00000100:00100000:3.0:1787032192.816795:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 227 00000100:00100000:3.0:1787032192.816827:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:5573:x1873838834989952:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032192.816860:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032192.816900:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b273d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032192.816941:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032192.816955:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032192.816967:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419c00, rc 0) 00000100:00100000:3.0:1787032192.817042:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834989952:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 Request processed in 218us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032192.817050:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 227 00000100:00100000:1.0:1787032192.821718:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032192.821799:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834990080 00000100:00100000:3.0:1787032192.821815:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834990080 00000100:00100000:3.0:1787032192.821935:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 228 00000100:00100000:3.0:1787032192.821949:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834990080:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032192.822879:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834990080:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 Request processed in 926us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032192.822892:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 228 00000100:00100000:3.0:1787032192.837900:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032192.838641:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834990208 00000100:00100000:2.0:1787032192.838658:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834990208 00000100:00100000:2.0:1787032192.838739:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 229 00000100:00100000:2.0:1787032192.838751:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834990208:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032192.839110:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834990208:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 Request processed in 360us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032192.839120:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 229 00000100:00100000:1.0:1787032192.870582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032192.870708:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834990336 00000100:00100000:2.0:1787032192.870721:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834990336 00000100:00100000:2.0:1787032192.870796:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 230 00000100:00100000:2.0:1787032192.870809:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834990336:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032192.870832:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032192.870870:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2744 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032192.870931:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032192.870943:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032192.870955:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6200, rc 0) 00000100:00100000:2.0:1787032192.871031:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834990336:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 Request processed in 225us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032192.871039:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 230 00000100:00100000:1.0:1787032192.876901:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032192.877585:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834990464 00000100:00100000:3.0:1787032192.877600:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834990464 00000100:00100000:3.0:1787032192.877685:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 231 00000100:00100000:3.0:1787032192.877697:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834990464:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032192.889907:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834990464:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 Request processed in 12190us (13000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032192.889928:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 231 00000100:00100000:1.0:1787032192.916398:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032192.916548:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834990592 00000100:00100000:3.0:1787032192.916561:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834990592 00000100:00100000:3.0:1787032192.916635:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 232 00000100:00100000:3.0:1787032192.916648:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834990592:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032192.917033:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834990592:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 Request processed in 385us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032192.917043:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 232 10000000:01000000:1.0:1787032193.089143:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787032193.089154:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdc4c91800 from 7 10000000:01000000:1.0:1787032193.089160:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787032193.089223:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.089237:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.089249:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032193.089293:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857045504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787032193.089383:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032193.089456:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf487acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032193.089707:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857045504 00000100:00100000:3.0:1787032193.089717:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857045504 00000100:00100000:3.0:1787032193.089773:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787032193.089782:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857045504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032193.089799:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032193.089816:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9934 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.089845:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.089867:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.089876:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418e00, rc 0) 00000100:00100000:3.0:1787032193.089932:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857045504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032193.089939:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787032193.090177:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857045504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032193.090196:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.090206:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032193.090294:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857045632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032193.090323:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032193.090347:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf487acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032193.090436:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857045632 00000100:00100000:3.0:1787032193.090441:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857045632 00000100:00100000:3.0:1787032193.090488:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787032193.090494:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857045632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.090837:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857045632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032193.090845:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787032193.091464:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857045632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032193.091515:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857045760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032193.091582:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032193.091619:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf487acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032193.091965:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857045760 00000100:00100000:3.0:1787032193.091972:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857045760 00000100:00100000:3.0:1787032193.092033:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787032193.092042:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857045760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.093398:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857045760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1349us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032193.093412:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787032193.095772:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857045760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787032193.104131:0:11052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787032193.107518:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787032193.107576:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787032193.107591:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.107606:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032193.107620:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787032193.107623:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdefa84800 from 7 10000000:01000000:3.0:1787032193.107627:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787032193.107681:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.107689:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.107727:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032193.107759:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857045888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.107867:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032193.107922:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdefc70480 going to sleep for 11 seconds 00000100:00100000:1.0:1787032193.108882:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857045888 00000100:00100000:1.0:1787032193.108897:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857045888 00000100:00100000:1.0:1787032193.115147:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787032193.115177:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857045888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032193.115202:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032193.115233:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9942 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.115282:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.115321:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.115331:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774200, rc 0) 00000100:00100000:1.0:1787032193.115445:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857045888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (7579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032193.115453:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787032193.115940:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857045888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032193.115967:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.115979:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032193.116111:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.116157:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032193.116202:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdefc70480 going to sleep for 11 seconds 00000100:00100000:1.0:1787032193.116618:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857046016 00000100:00100000:1.0:1787032193.116626:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857046016 00000100:00100000:1.0:1787032193.116681:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787032193.116691:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857046016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032193.118885:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857046016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2186us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032193.118901:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787032193.143904:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032193.144375:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032193.144478:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032193.144537:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf487acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032193.145412:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857046144 00000100:00100000:3.0:1787032193.145425:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857046144 00000100:00100000:3.0:1787032193.145509:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787032193.145521:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857046144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.145868:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857046144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 348us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032193.145876:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787032193.146430:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787032193.149311:0:11054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787032193.149839:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787032193.149904:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787032193.149923:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.149937:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032193.149951:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787032193.149954:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cde4b73800 from 7 10000000:01000000:3.0:1787032193.149957:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787032193.150023:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.150032:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.150045:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032193.150100:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.150190:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032193.150247:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdefc70c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032193.151212:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857046272 00000100:00100000:1.0:1787032193.151225:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857046272 00000100:00100000:1.0:1787032193.151298:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787032193.151308:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857046272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032193.151329:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032193.151350:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9950 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.151392:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.151404:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.151414:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032193.151496:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857046272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032193.151504:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787032193.152766:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032193.152798:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032193.152812:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032193.152943:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.153183:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032193.153233:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdefc70c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032193.156122:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857046400 00000100:00100000:1.0:1787032193.156143:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857046400 00000100:00100000:1.0:1787032193.156216:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787032193.156227:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857046400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032193.156639:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857046400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 412us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032193.156648:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787032193.160163:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.160266:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032193.160387:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032193.160436:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdefc70c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032193.160880:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857046528 00000100:00100000:2.0:1787032193.162893:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857046528 00000100:00100000:2.0:1787032193.163632:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787032193.163650:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857046528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032193.165608:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857046528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1954us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032193.165626:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787032193.169494:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef003100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857046528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787032193.171708:0:11055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787032193.174023:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787032193.174088:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787032193.174105:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032193.174121:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032193.729354:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032194.692596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032194.692636:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032194.692659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032194.692687:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834990720 00000100:00100000:1.0:1787032194.692696:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834990720 00000100:00100000:1.0:1787032194.692742:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 242 00000100:00100000:1.0:1787032194.692751:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834990720:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032194.692900:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834990848 00000100:00100000:2.0:1787032194.692905:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834990848 00000100:00100000:2.0:1787032194.692951:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834990976 00000100:00100000:2.0:1787032194.692954:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834990976 00000100:00100000:2.0:1787032194.692979:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 90 00000100:00100000:2.0:1787032194.692987:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834990848:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032194.693053:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834990848:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 66us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032194.693061:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 90 00000100:00100000:2.0:1787032194.693108:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 91 00000100:00100000:2.0:1787032194.693114:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834990976:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032194.693135:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834990976:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 22us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032194.693141:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 91 00000100:00100000:1.0:1787032194.693337:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834990720:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 586us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032194.693351:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 242 00000100:00080000:1.0:1787032194.693485:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787032194.758676:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032195.777260:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787032196.635639:0:11227:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787032196.804702:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032196.868736:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857046912:0@lo:400:kworker.0 00000100:00100000:2.0:1787032196.868844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032196.868925:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032196.868932:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857047040:0@lo:400:kworker.0 00000100:00100000:2.0:1787032196.868965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032196.869294:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857046912 00000100:00100000:2.0:1787032196.869305:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857046912 00000100:00100000:2.0:1787032196.869367:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787032196.869375:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857046912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032196.869431:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857046912:12345-0@lo:400:kworker.0 Request processed in 56us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032196.869438:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787032196.869477:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857046912:0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.869636:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857046656:0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.869673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032196.869704:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857047168:0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.869727:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032196.869756:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787032196.869763:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857046784:0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.869795:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032196.869815:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857047296:0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.869838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787032196.869871:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032196.869885:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857047168 00000100:00100000:1.0:1787032196.869889:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857047168 00000100:00100000:1.0:1787032196.869921:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857046784 00000100:00100000:1.0:1787032196.869925:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857046784 00000100:00100000:1.0:1787032196.869940:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787032196.869947:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857047168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.869994:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857047168:12345-0@lo:400:kworker.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032196.870001:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787032196.870014:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787032196.870020:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857046784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.870097:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857046784:12345-0@lo:400:kworker.0 Request processed in 76us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032196.870103:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787032196.870129:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857047040 00000100:00100000:1.0:1787032196.870132:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857047040 00000100:00100000:1.0:1787032196.870160:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857047296 00000100:00100000:1.0:1787032196.870163:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857047296 00000100:00100000:1.0:1787032196.870183:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787032196.870188:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857047040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.870412:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857047040:12345-0@lo:400:kworker.0 Request processed in 223us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032196.870420:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787032196.870432:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787032196.870439:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857047296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.870469:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857047296:12345-0@lo:400:kworker.0 Request processed in 31us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032196.870475:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787032196.870581:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef890e00 x1873838857047040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032196.870595:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857047040:0@lo:400:kworker.0 00000100:00080000:1.0:1787032196.870616:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787032196.870620:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787032196.870622:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032196.870639:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857046784:0@lo:400:kworker.0 00010000:00080000:1.0:1787032196.870650:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef890a80 x1873838857047296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032196.870671:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857047296:0@lo:400:kworker.0 00000100:00100000:1.0:1787032196.870685:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857047168:0@lo:400:kworker.0 00000100:00100000:2.0:1787032196.870928:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857046656 00000100:00100000:2.0:1787032196.870933:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857046656 00000100:00100000:2.0:1787032196.870967:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787032196.870991:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857046656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032196.871038:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857046656:12345-0@lo:400:kworker.0 Request processed in 59us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032196.871203:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857046656:0@lo:400:kworker.0 00000100:00100000:2.0:1787032196.871326:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787032197.377610:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857047552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032197.377686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032197.377764:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787032197.377800:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857047424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032197.377827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032197.377906:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857047552 00000100:00100000:2.0:1787032197.377914:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857047552 00000100:00100000:2.0:1787032197.377964:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857047424 00000100:00100000:2.0:1787032197.377967:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857047424 00000100:00100000:2.0:1787032197.377986:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787032197.377995:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857047552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032197.378054:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032197.378138:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857047552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032197.378146:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787032197.378163:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032197.378169:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857047424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032197.378187:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032197.378491:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857047424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032197.378497:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787032197.379350:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4872300 x1873838857047424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032197.379374:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857047424:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787032197.379387:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef892680 x1873838857047552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032197.379399:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857047552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787032197.825495:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032198.851655:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032199.814644:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032199.814733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032199.814773:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032199.815059:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834991360 00000100:00100000:3.0:1787032199.815130:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834991360 00000100:00100000:3.0:1787032199.815269:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834991232 00000100:00100000:3.0:1787032199.815272:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834991232 00000100:00100000:3.0:1787032199.815304:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 95 00000100:00100000:3.0:1787032199.815315:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834991360:12345-192.168.201.48@tcp:400:kworker.0 00000100:00080000:1.0:1787032199.815410:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032199.815500:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834991104 00000100:00100000:2.0:1787032199.815505:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834991104 00000100:00100000:2.0:1787032199.815547:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 244 00000100:00100000:2.0:1787032199.815556:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834991104:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032199.815584:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834991360:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 271us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032199.815584:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834991104:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 31us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032199.815593:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 95 00000100:00100000:2.0:1787032199.815600:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 244 00000100:00100000:3.0:1787032199.815614:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 96 00000100:00100000:3.0:1787032199.815619:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834991232:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032199.815644:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838834991232:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 24us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032199.815651:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 96 00010000:00010000:3.0:1787032199.874914:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032200.898116:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787032201.422685:0:11328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:49:59 (1787032199) === 00000100:00100000:1.0:1787032201.656464:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032201.656503:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032201.656544:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834991616 00000100:00100000:1.0:1787032201.656553:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834991616 00000100:00100000:1.0:1787032201.656622:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:1.0:1787032201.656632:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d144536-0f5d-43dc-8f25-f68546215872+6:9652:x1873838834991616:12345-192.168.201.48@tcp:700:mkdir.0 00000100:00100000:1.0:1787032201.656732:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d144536-0f5d-43dc-8f25-f68546215872+6:9652:x1873838834991616:12345-192.168.201.48@tcp:700:mkdir.0 Request processed in 101us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032201.656740:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00080000:1.0:1787032201.656763:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032201.657404:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834991488 00000100:00100000:0.0:1787032201.657411:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834991488 00000100:00100000:0.0:1787032201.657453:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:0.0:1787032201.657460:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834991488:12345-192.168.201.48@tcp:41:mkdir.0 00000004:00000024:0.0:1787032201.657507:0:7755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787032201.657574:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838834991488:12345-192.168.201.48@tcp:41:mkdir.0 Request processed in 115us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032201.657580:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:2.0:1787032201.667166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032201.667387:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834991872 00000100:00100000:3.0:1787032201.667396:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834991872 00000100:00100000:3.0:1787032201.667456:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:3.0:1787032201.667465:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:9652:x1873838834991872:12345-192.168.201.48@tcp:36:mkdir.0 00010000:00010000:3.0:1787032201.667522:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032201.667551:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e983f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26c6 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.667572:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864a00) 00010000:00010000:3.0:1787032201.667581:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032201.667917:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.667932:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.667942:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.667965:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.667973:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.667980:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032201.669306:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787032201.669322:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.669331:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.669339:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.669345:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032201.669350:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.669359:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.669373:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a500) 00010000:00010000:3.0:1787032201.669376:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032201.669379:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.669395:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e995e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032201.669415:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e314beaf reply state 000000002509c1b1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032201.669424:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787032201.669523:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:9652:x1873838834991872:12345-192.168.201.48@tcp:36:mkdir.0 Request processed in 2056us (2364us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787032201.669531:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 15 00010000:00010000:1.0:1787032201.689185:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.689205:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.689214:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.689221:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032201.689241:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.689248:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.689269:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cdcba3a200) 00010000:00010000:1.0:1787032201.689273:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032201.689289:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.689297:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9965 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032201.693808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032201.694789:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834992000 00000100:00100000:3.0:1787032201.694801:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834992000 00000100:00100000:3.0:1787032201.694872:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:3.0:1787032201.694883:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:9653:x1873838834992000:12345-192.168.201.48@tcp:101:chmod.0 00010000:00010000:3.0:1787032201.694906:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032201.694931:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e996c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b274b expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.695004:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419800/0xcd047797ef1e9973 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.695019:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419800/0xcd047797ef1e9973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.695030:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419800/0xcd047797ef1e9973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032201.695110:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787032201.695114:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032201.695182:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419800/0xcd047797ef1e9973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.695211:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e996c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b274b expref: 8 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.695229:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419800/0xcd047797ef1e9973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b274b expref: 7 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.695237:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3ab00) 00010000:00010000:3.0:1787032201.695241:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787032201.695244:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419800, rc 0) 00000100:00100000:3.0:1787032201.695314:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:9653:x1873838834992000:12345-192.168.201.48@tcp:101:chmod.0 Request processed in 431us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032201.695321:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:2.0:1787032201.698376:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032201.698500:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834992256 00000100:00100000:3.0:1787032201.698511:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834992256 00000100:00100000:3.0:1787032201.698576:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:3.0:1787032201.698585:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:9653:x1873838834992256:12345-192.168.201.48@tcp:36:chmod.0 00010000:00010000:3.0:1787032201.698759:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032201.698785:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419800/0xcd047797ef1e9973 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b274b expref: 7 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.698802:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3ab00) 00010000:00010000:3.0:1787032201.698813:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032201.698838:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.698850:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.698871:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032201.699559:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000850e4238 reply state 000000001f5358e7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032201.699573:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787032201.699591:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787032201.699712:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:9653:x1873838834992256:12345-192.168.201.48@tcp:36:chmod.0 Request processed in 1126us (1343us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787032201.699720:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00010000:00010000:2.0:1787032201.701487:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.701503:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.701511:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.701516:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032201.701521:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.701529:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.701544:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a500) 00010000:00010000:2.0:1787032201.701548:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787032201.701552:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.701559:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e997a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032201.757767:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032201.757883:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834992384 00000100:00100000:3.0:1787032201.757894:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834992384 00000100:00100000:3.0:1787032201.757997:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032201.758018:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:9654:x1873838834992384:12345-192.168.201.48@tcp:101:chown.0 00010000:00010000:3.0:1787032201.758042:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032201.758106:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419800/0xcd047797ef1e9981 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2752 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.758285:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9988 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.758300:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.758312:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032201.758373:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787032201.758383:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032201.758424:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.758449:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419800/0xcd047797ef1e9981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2752 expref: 9 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.758468:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9988 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2752 expref: 8 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.758476:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3ab00) 00010000:00010000:3.0:1787032201.758479:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787032201.758482:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419200, rc 0) 00000100:00100000:3.0:1787032201.758534:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+8:9654:x1873838834992384:12345-192.168.201.48@tcp:101:chown.0 Request processed in 529us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032201.758541:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032201.771547:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032201.772399:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834992512 00000100:00100000:2.0:1787032201.772410:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834992512 00000100:00100000:2.0:1787032201.772473:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:2.0:1787032201.772483:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:9654:x1873838834992512:12345-192.168.201.48@tcp:101:chown.0 00010000:00010000:2.0:1787032201.772507:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032201.772529:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7200/0xcd047797ef1e998f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2759 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772596:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772625:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772638:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772654:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772661:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772669:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772782:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e99a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772791:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e99a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772817:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e99a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032201.772862:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787032201.772867:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032201.772895:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e99a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772908:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772915:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772921:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772928:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032201.772932:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772940:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772953:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3ab00) 00010000:00010000:2.0:1787032201.772956:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032201.772961:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772967:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e9996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772990:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.772995:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.773000:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.773005:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032201.773008:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.773014:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.773021:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cdc3864500) 00010000:00010000:2.0:1787032201.773023:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032201.773026:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.773031:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e999d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.773104:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7200/0xcd047797ef1e998f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2759 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.773120:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e99a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2759 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.773750:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:2.0:1787032201.773753:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032201.773756:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7400, rc 0) 00000100:00100000:2.0:1787032201.773876:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:9654:x1873838834992512:12345-192.168.201.48@tcp:101:chown.0 Request processed in 1393us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032201.773885:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:2.0:1787032201.782752:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032201.783283:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834992768 00000100:00100000:1.0:1787032201.783303:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834992768 00000100:00100000:1.0:1787032201.783387:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:1.0:1787032201.783398:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+9:9654:x1873838834992768:12345-192.168.201.48@tcp:36:chown.0 00010000:00010000:1.0:1787032201.783467:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032201.783497:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e99a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2759 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.783519:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:1.0:1787032201.783530:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032201.783557:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.783570:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.783579:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787032201.875224:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787032201.875294:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004142e412 reply state 00000000862ec2c6 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032201.875308:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787032201.875491:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787032201.875589:0:5798:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787032201.875628:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:9654:x1873838834992768:12345-192.168.201.48@tcp:36:chown.0 Request processed in 92224us (92888us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787032201.875639:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 20 00010000:00010000:2.0:1787032201.875682:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.875701:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.875709:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.875715:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032201.875721:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.875737:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.875755:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffb00) 00010000:00010000:2.0:1787032201.875757:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787032201.875762:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.875769:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032201.922322:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032201.923526:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032201.924883:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834992896 00000100:00100000:1.0:1787032201.924899:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834992896 00000100:00100000:1.0:1787032201.924983:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:1.0:1787032201.924993:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:9655:x1873838834992896:12345-192.168.201.48@tcp:101:touch.500 00010000:00010000:1.0:1787032201.925019:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032201.925041:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774e00/0xcd047797ef1e99b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2760 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787032201.938732:0:5799:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 13577us 00010000:00010000:1.0:1787032201.973359:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.973392:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.973408:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.973430:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.973438:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.973444:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974043:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e99c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974053:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e99c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974099:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e99c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032201.974403:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787032201.974408:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032201.974512:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e99c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974529:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974536:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974544:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974551:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032201.974556:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974565:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974581:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3ab00) 00010000:00010000:1.0:1787032201.974584:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032201.974589:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974595:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e99b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974622:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974629:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974635:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974641:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032201.974645:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974651:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974659:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cdce1ff000) 00010000:00010000:1.0:1787032201.974661:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032201.974664:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974669:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e99c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974732:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774e00/0xcd047797ef1e99b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2760 expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974750:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e99c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2760 expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032201.974771:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:1.0:1787032201.974774:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787032201.974777:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775600, rc 0) 00000100:00100000:1.0:1787032201.974900:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:9655:x1873838834992896:12345-192.168.201.48@tcp:101:touch.500 Request processed in 49904us (51383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032201.974910:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:2.0:1787032201.987527:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032201.987671:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834993152 00000100:00100000:1.0:1787032201.987700:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834993152 00000100:00100000:2.0:1787032201.990733:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857047680:0@lo:400:kworker.0 00000100:00100000:2.0:1787032201.990903:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032201.991206:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857048064:0@lo:400:kworker.0 00000100:00100000:3.0:1787032201.991249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032201.991624:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857047808:0@lo:400:kworker.0 00000100:00100000:1.0:1787032201.991683:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032201.991814:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857047936:0@lo:400:kworker.0 00000100:00100000:0.0:1787032201.991866:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032201.992297:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857048192:0@lo:400:kworker.0 00000100:00100000:2.0:1787032201.992330:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032201.992366:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857047680 00000100:00100000:2.0:1787032201.992377:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857047680 00000100:00100000:2.0:1787032201.992431:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787032201.992442:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857047680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032201.992506:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857047680:12345-0@lo:400:kworker.0 Request processed in 66us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032201.992514:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787032201.992555:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857047808 00000100:00100000:2.0:1787032201.992559:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857047808 00000100:00100000:2.0:1787032201.992578:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857047936 00000100:00100000:2.0:1787032201.992582:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857047936 00000100:00100000:2.0:1787032201.992610:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857048192 00000100:00100000:2.0:1787032201.992633:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857048192 00000100:00100000:2.0:1787032201.992653:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787032201.992659:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857047808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032201.992707:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857047808:12345-0@lo:400:kworker.0 Request processed in 48us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032201.992713:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787032201.992726:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787032201.992732:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857047936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032201.992760:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857047936:12345-0@lo:400:kworker.0 Request processed in 28us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032201.992766:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787032201.992777:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787032201.992783:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857048192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032201.992811:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857048192:12345-0@lo:400:kworker.0 Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032201.992816:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787032201.992828:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:2.0:1787032201.992834:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:9655:x1873838834993152:12345-192.168.201.48@tcp:101:touch.500 00010000:00010000:2.0:1787032201.992850:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032201.998336:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7200/0xcd047797ef1e99ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2767 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.998865:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.998885:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032201.998910:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032202.000006:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857048192:0@lo:400:kworker.0 00000100:00100000:3.0:1787032202.000027:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857047680:0@lo:400:kworker.0 00000100:00080000:3.0:1787032202.000093:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032202.001293:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857047808:0@lo:400:kworker.0 00000100:00100000:1.0:1787032202.001312:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857048320:0@lo:400:kworker.0 00000100:00100000:1.0:1787032202.001406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032202.001501:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857048064 00000100:00100000:1.0:1787032202.001510:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857048064 00000100:00100000:1.0:1787032202.001586:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857048320 00000100:00100000:1.0:1787032202.001590:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857048320 00000100:00100000:1.0:1787032202.001626:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787032202.001636:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857048064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032202.001717:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857048064:12345-0@lo:400:kworker.0 Request processed in 82us (10466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032202.001724:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787032202.001743:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787032202.001749:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857048320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032202.001781:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857048320:12345-0@lo:400:kworker.0 Request processed in 33us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032202.001806:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787032202.001840:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdff5c8000 x1873838857048320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032202.001852:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857048320:0@lo:400:kworker.0 00000100:00080000:1.0:1787032202.001890:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787032202.001895:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787032202.001917:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdff5cb100 x1873838857048064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032202.001928:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857048064:0@lo:400:kworker.0 00000100:00100000:0.0:1787032202.002052:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857047936:0@lo:400:kworker.0 00010000:00010000:2.0:1787032202.006620:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.006648:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.006662:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787032202.014667:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787032202.015001:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e99e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015021:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e99e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015034:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e99e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015101:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015109:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015116:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015123:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032202.015133:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015141:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015155:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:2.0:1787032202.015159:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032202.015163:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015169:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e99d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787032202.015182:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b218d576 reply state 000000007aad868e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032202.015191:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787032202.015227:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7200/0xcd047797ef1e99ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2767 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015243:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e99e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2767 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.015253:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cdc3864500) 00010000:00010000:2.0:1787032202.015257:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032202.015259:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6c00, rc 0) 00000100:00100000:2.0:1787032202.015337:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+10:9655:x1873838834993152:12345-192.168.201.48@tcp:101:touch.500 Request processed in 22501us (27824us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787032202.015346:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 22 00010000:00010000:2.0:1787032202.025502:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.025523:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.025531:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.025537:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032202.025542:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.025549:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.025567:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x54725cf5 (ffff99cdc3864100) 00010000:00010000:2.0:1787032202.025570:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032202.025575:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.025581:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1e99dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032202.028659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032202.028867:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834993408 00000100:00100000:3.0:1787032202.028895:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834993408 00000100:00100000:3.0:1787032202.028998:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:3.0:1787032202.029011:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+9:9655:x1873838834993408:12345-192.168.201.48@tcp:36:touch.500 00010000:00010000:3.0:1787032202.029341:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032202.029379:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e99e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2767 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032202.029405:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cdc3864500) 00010000:00010000:3.0:1787032202.029421:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032202.029481:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032202.029497:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032202.029508:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032202.029679:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9c4c19a reply state 00000000a19fe35d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032202.029703:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787032202.029837:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+10:9655:x1873838834993408:12345-192.168.201.48@tcp:36:touch.500 Request processed in 827us (1188us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787032202.029846:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 23 00010000:00010000:2.0:1787032202.036805:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.036826:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.036835:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.036861:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032202.036866:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.036874:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.036891:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cdcba3ac00) 00010000:00010000:2.0:1787032202.036894:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032202.036898:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.036905:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e99f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032202.040200:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032202.041850:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834993536 00000100:00100000:0.0:1787032202.041866:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834993536 00000100:00100000:0.0:1787032202.041948:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:0.0:1787032202.041961:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+9:9655:x1873838834993536:12345-192.168.201.48@tcp:101:touch.500 00010000:00010000:0.0:1787032202.041991:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032202.042020:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e99f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b276e expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.042128:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e99f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b276e expref: 10 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.042146:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e99f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b276e expref: 10 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.042165:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cdc4f0a300) 00010000:00010000:0.0:1787032202.042169:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032202.042172:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030e00, rc 0) 00000100:00100000:0.0:1787032202.042231:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+10:9655:x1873838834993536:12345-192.168.201.48@tcp:101:touch.500 Request processed in 274us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032202.042255:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:3.0:1787032202.048516:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032202.054354:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834993664 00000100:00100000:1.0:1787032202.054383:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834993664 00000100:00100000:1.0:1787032202.054467:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:1.0:1787032202.054480:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1873838834993664:12345-192.168.201.48@tcp:8:touch.500 00010000:00080000:1.0:1787032202.054528:0:6584:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:1.0:1787032202.054574:0:6584:0:(genops.c:1406:class_connect()) connect: client 5d144536-0f5d-43dc-8f25-f68546215872, cookie 0xcd047797ef1e99ff 00002000:00100000:1.0:1787032202.054590:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d144536-0f5d-43dc-8f25-f68546215872/ffff99cdc4e36000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787032202.054623:0:6584:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787032202.057515:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787032202.057583:0:6584:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e33000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787032202.057782:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2353:x1873838834993664:12345-192.168.201.48@tcp:8:touch.500 Request processed in 3301us (9280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032202.057796:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:1.0:1787032202.076411:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032202.077492:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834993792 00000100:00100000:3.0:1787032202.077510:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834993792 00000100:00100000:3.0:1787032202.077624:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032202.077636:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:0:x1873838834993792:12345-192.168.201.48@tcp:2:touch.500 00000100:00080000:1.0:1787032202.078308:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032202.169220:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:0:x1873838834993792:12345-192.168.201.48@tcp:2:touch.500 Request processed in 91574us (92814us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787032202.169235:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000001:00100000:1.0:1787032202.169384:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000001:00080000:1.0:1787032202.169402:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1787032202.178931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032202.179452:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834994048 00000100:00100000:0.0:1787032202.179464:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834994048 00000100:00100000:0.0:1787032202.179530:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:0.0:1787032202.179540:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+10:9655:x1873838834994048:12345-192.168.201.48@tcp:35:touch.500 00000100:00100000:0.0:1787032202.180208:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+11:9655:x1873838834994048:12345-192.168.201.48@tcp:35:touch.500 Request processed in 667us (1285us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787032202.180217:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:0.0:1787032202.216736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032202.216892:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834994176 00000100:00100000:1.0:1787032202.216904:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834994176 00000100:00100000:1.0:1787032202.216974:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 25 00000100:00100000:1.0:1787032202.216984:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+11:9656:x1873838834994176:12345-192.168.201.48@tcp:101:rm.0 00010000:00010000:1.0:1787032202.217010:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032202.217032:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9a06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2775 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.217144:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9a0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.217159:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.217173:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032202.217239:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787032202.217244:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032202.217289:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.217549:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9a06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2775 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.217568:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2775 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.217595:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:1.0:1787032202.217775:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787032202.217779:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775200, rc 0) 00000100:00100000:0.0:1787032202.223996:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+12:9656:x1873838834994176:12345-192.168.201.48@tcp:101:rm.0 Request processed in 6998us (7254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032202.224009:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 25 00000100:00100000:1.0:1787032202.242243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032202.242347:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834994432 00000100:00100000:2.0:1787032202.242358:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834994432 00000100:00100000:2.0:1787032202.242424:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 26 00000100:00100000:2.0:1787032202.242746:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+12:9656:x1873838834994432:12345-192.168.201.48@tcp:101:rm.0 00010000:00010000:2.0:1787032202.242773:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032202.242797:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7200/0xcd047797ef1e9a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b277c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032202.242926:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787032202.244169:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7200/0xcd047797ef1e9a14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b277c expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032202.244189:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3ab00) 00010000:00010000:3.0:1787032202.244192:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787032202.244198:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7200/0xcd047797ef1e9a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b277c expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032202.244211:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7200, rc 0) 00000100:00100000:3.0:1787032202.244350:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+13:9656:x1873838834994432:12345-192.168.201.48@tcp:101:rm.0 Request processed in 1916us (2117us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787032202.244360:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 26 00000100:00100000:3.0:1787032202.260811:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032202.261002:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834994560 00000100:00100000:1.0:1787032202.261014:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834994560 00000100:00100000:1.0:1787032202.261113:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:1.0:1787032202.261125:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+13:9656:x1873838834994560:12345-192.168.201.48@tcp:37:rm.0 00000100:00100000:2.0:1787032202.266903:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+13:9656:x1873838834994560:12345-192.168.201.48@tcp:37:rm.0 Request processed in 5770us (6091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032202.266921:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:3.0:1787032202.277441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032202.278539:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834994816 00000100:00100000:0.0:1787032202.278557:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834994816 00000100:00100000:0.0:1787032202.278652:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:0.0:1787032202.278665:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+13:9656:x1873838834994816:12345-192.168.201.48@tcp:35:rm.0 00000100:00100000:0.0:1787032202.279106:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:9656:x1873838834994816:12345-192.168.201.48@tcp:35:rm.0 Request processed in 442us (1679us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787032202.279114:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:3.0:1787032202.283046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032202.287489:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834995072 00000100:00100000:2.0:1787032202.287515:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834995072 00000100:00100000:2.0:1787032202.287626:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:2.0:1787032202.287639:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:9656:x1873838834995072:12345-192.168.201.48@tcp:101:rm.0 00010000:00010000:2.0:1787032202.287673:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032202.287721:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2783 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.289252:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9a29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.289398:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9a29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.289414:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9a29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032202.289436:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787032202.289728:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2783 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.289759:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9a29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2783 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.289770:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:2.0:1787032202.289774:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787032202.289779:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6400, rc 0) 00000100:00100000:2.0:1787032202.289952:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+16:9656:x1873838834995072:12345-192.168.201.48@tcp:101:rm.0 Request processed in 2315us (6922us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787032202.289974:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:3.0:1787032202.298044:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032202.303438:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834995200 00000100:00100000:0.0:1787032202.303461:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834995200 00000100:00100000:0.0:1787032202.303561:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:0.0:1787032202.303573:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+16:9656:x1873838834995200:12345-192.168.201.48@tcp:41:rm.0 00000004:00000024:0.0:1787032202.303654:0:7755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787032202.303777:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+16:9656:x1873838834995200:12345-192.168.201.48@tcp:41:rm.0 Request processed in 205us (5748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032202.303805:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:3.0:1787032202.307905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032202.308189:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834995328 00000100:00100000:0.0:1787032202.308203:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834995328 00000100:00100000:0.0:1787032202.308279:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:0.0:1787032202.308292:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+16:9656:x1873838834995328:12345-192.168.201.48@tcp:101:rm.0 00010000:00010000:0.0:1787032202.308320:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032202.308348:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b278a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308433:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308450:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308464:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308480:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308487:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308492:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308651:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9a4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308697:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308705:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032202.308741:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787032202.308745:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032202.308768:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308781:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308791:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308798:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308805:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308811:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032202.308816:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308823:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308837:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:0.0:1787032202.308841:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032202.308854:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.308861:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309606:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309618:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309625:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309630:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032202.309634:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309641:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309653:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x54725cf5 (ffff99cdc4f0a000) 00010000:00010000:0.0:1787032202.309655:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032202.309659:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309665:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309725:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b278a expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309759:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b278a expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.309768:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cdc4f0a300) 00010000:00010000:0.0:1787032202.309770:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032202.309773:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0031c00, rc 0) 00000100:00100000:0.0:1787032202.309862:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+17:9656:x1873838834995328:12345-192.168.201.48@tcp:101:rm.0 Request processed in 1574us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032202.309871:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:2.0:1787032202.319473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032202.319532:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834995584 00000100:00100000:0.0:1787032202.319546:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834995584 00000100:00100000:0.0:1787032202.319623:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 30 00000100:00100000:0.0:1787032202.319634:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+17:9656:x1873838834995584:12345-192.168.201.48@tcp:36:rm.0 00010000:00010000:0.0:1787032202.319726:0:7755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787032202.319766:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9a4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b278a expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.319794:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e99f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b276e expref: 16 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.319808:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cdc4f0a300) 00010000:00010000:0.0:1787032202.319828:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9a0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2775 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.319838:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:0.0:1787032202.319860:0:7755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032202.319982:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.319998:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.320261:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.320292:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.320301:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.320308:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.320556:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.320565:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.320572:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787032202.326648:0:7755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787032202.326671:0:7755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357172602509ns, next at 358172597911ns, rc = 0 00010000:00010000:0.0:1787032202.326784:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326826:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326841:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326854:0:7755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326861:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326868:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326895:0:7755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032202.326934:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326940:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326947:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326954:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032202.326959:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326968:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.326994:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:0.0:1787032202.326998:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787032202.327004:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.327012:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9a61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.327040:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.327047:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.327053:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.327059:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032202.327061:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.327123:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.327132:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:0.0:1787032202.327135:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032202.327139:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.327146:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9a53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787032202.327170:0:7755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038f9c9b6 reply state 0000000091f1fd13 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032202.327182:0:7755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787032202.327770:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032202.327782:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.327791:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032202.327795:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.327802:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.327813:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:1.0:1787032202.327816:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787032202.327820:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.327825:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1e9a68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.327846:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032202.327861:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032202.327864:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032202.328612:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+16:9656:x1873838834995584:12345-192.168.201.48@tcp:36:rm.0 Request processed in 8969us (9143us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787032202.328624:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 30 00010000:00010000:1.0:1787032202.334879:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.334903:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.334912:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.334920:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032202.334926:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.334934:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.334955:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x54725cf5 (ffff99cdc4f0a000) 00010000:00010000:1.0:1787032202.334959:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032202.334964:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032202.334972:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1e9a5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x54725cf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032202.346594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032202.347011:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834995840 00000100:00100000:0.0:1787032202.347025:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834995840 00000100:00100000:0.0:1787032202.347131:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:0.0:1787032202.347143:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:9656:x1873838834995840:12345-192.168.201.48@tcp:35:rm.0 00000100:00100000:0.0:1787032202.347637:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+16:9656:x1873838834995840:12345-192.168.201.48@tcp:35:rm.0 Request processed in 494us (1058us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787032202.347647:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:1.0:1787032202.351375:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032202.351560:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834996096 00000100:00100000:2.0:1787032202.351572:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834996096 00000100:00100000:2.0:1787032202.351645:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 31 00000100:00100000:2.0:1787032202.351656:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+16:9656:x1873838834996096:12345-192.168.201.48@tcp:36:rm.0 00010000:00010000:2.0:1787032202.351750:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787032202.351790:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9a29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2783 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.351817:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e99c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2760 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.351832:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:2.0:1787032202.351847:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9988 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2752 expref: 14 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.351857:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3ab00) 00010000:00010000:2.0:1787032202.351864:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032202.351896:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.351912:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.351925:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.351964:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.351973:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.351980:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.352600:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.352612:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.352620:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032202.354539:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787032202.354574:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354585:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354593:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354599:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032202.354606:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354631:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354651:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cdc3864b00) 00010000:00010000:2.0:1787032202.354655:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787032202.354660:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354667:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9a7d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354709:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354716:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354722:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354727:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032202.354730:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354736:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354745:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864900) 00010000:00010000:2.0:1787032202.354748:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032202.354751:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032202.354767:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1e9a6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787032202.354782:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005cdc8f24 reply state 00000000e8b531c4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032202.354794:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787032202.354927:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:9656:x1873838834996096:12345-192.168.201.48@tcp:36:rm.0 Request processed in 3266us (3560us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787032202.354937:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 31 00010000:00010000:0.0:1787032202.365324:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.365349:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.365358:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.365366:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032202.365372:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.365381:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.365424:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cdc3864100) 00010000:00010000:0.0:1787032202.365429:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032202.365435:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032202.365444:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9a76 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032202.498053:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857048448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032202.498401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032202.503563:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857048448 00000100:00100000:3.0:1787032202.503587:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857048448 00000100:00100000:3.0:1787032202.503706:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787032202.503720:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857048448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787032202.503760:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032202.504050:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857048576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032202.504146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032202.504208:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857048576 00000100:00100000:2.0:1787032202.504212:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857048576 00000100:00100000:2.0:1787032202.504244:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787032202.504252:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857048576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032202.504296:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032202.504335:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857048576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032202.504342:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787032202.504393:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4872680 x1873838857048576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032202.504419:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857048576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032202.509483:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857048448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5747us (11064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032202.509505:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787032202.509879:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdc8d5b480 x1873838857048448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032202.509934:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857048448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787032202.948584:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032203.970100:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032204.936849:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032204.938794:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032204.938881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032204.938914:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032204.938950:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834996352 00000100:00100000:1.0:1787032204.938962:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834996352 00000100:00100000:1.0:1787032204.939033:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834996608 00000100:00100000:1.0:1787032204.939037:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834996608 00000100:00100000:1.0:1787032204.939088:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 100 00000100:00100000:1.0:1787032204.939103:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+14:2354:x1873838834996352:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032204.939209:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+14:2354:x1873838834996352:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 109us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032204.939218:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 100 00000100:00100000:1.0:1787032204.939240:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 101 00000100:00100000:1.0:1787032204.939247:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838834996608:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032204.939271:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838834996608:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032204.939278:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 101 00000100:00080000:1.0:1787032204.939299:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032204.941437:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834996224 00000100:00100000:2.0:1787032204.941458:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834996224 00000100:00100000:2.0:1787032204.941556:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 246 00000100:00100000:2.0:1787032204.941567:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838834996224:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032204.941793:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834996480 00000100:00100000:3.0:1787032204.941807:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834996480 00000100:00100000:3.0:1787032204.941876:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 57 00000100:00100000:3.0:1787032204.941886:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2354:x1873838834996480:12345-192.168.201.48@tcp:400:kworker.0 00000100:00080000:0.0:1787032204.942870:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032204.943533:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838834996224:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 1958us (6692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032204.943547:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 246 00000100:00100000:3.0:1787032204.952378:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2354:x1873838834996480:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 10477us (15458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032204.952397:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 57 00010000:00010000:3.0:1787032204.993218:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032206.017334:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032207.051735:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032207.105844:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857048832:0@lo:400:kworker.0 00000100:00100000:3.0:1787032207.105984:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfaf11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857048704:0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.106099:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857048960:0@lo:400:kworker.0 00000100:00100000:3.0:1787032207.106113:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032207.106161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032207.106207:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857049216:0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.106214:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032207.106245:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857049088:0@lo:400:kworker.0 00000100:00100000:3.0:1787032207.106265:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032207.106954:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857048704 00000100:00100000:3.0:1787032207.106962:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857048704 00000100:00100000:3.0:1787032207.107021:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787032207.107040:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857048704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032207.107131:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857048704:12345-0@lo:400:kworker.0 Request processed in 101us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032207.107139:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787032207.107838:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfaf11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857048704:0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.108651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032207.108750:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857048960 00000100:00100000:1.0:1787032207.108760:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857048960 00000100:00100000:1.0:1787032207.108831:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857049216 00000100:00100000:1.0:1787032207.108836:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857049216 00000100:00100000:1.0:1787032207.108868:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787032207.108881:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857048960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.108985:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857048960:12345-0@lo:400:kworker.0 Request processed in 107us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032207.108995:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787032207.109022:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787032207.109032:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857049216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.109102:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857049216:12345-0@lo:400:kworker.0 Request processed in 74us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032207.109109:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787032207.109181:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857049088 00000100:00100000:1.0:1787032207.109186:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857049088 00000100:00100000:1.0:1787032207.109216:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787032207.109223:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857049088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.109256:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857049088:12345-0@lo:400:kworker.0 Request processed in 34us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032207.109261:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787032207.109278:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787032207.109283:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032207.109331:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857049216:0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.109993:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032207.110141:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857049344:0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.110188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032207.110227:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857049344 00000100:00100000:1.0:1787032207.110232:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857049344 00000100:00100000:1.0:1787032207.110277:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787032207.110286:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857049344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.110337:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857049344:12345-0@lo:400:kworker.0 Request processed in 52us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032207.110345:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787032207.110381:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787032207.110414:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdffe08a80 x1873838857049344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032207.110427:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857049344:0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.110455:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857048832 00000100:00100000:1.0:1787032207.110460:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857048832 00000100:00100000:1.0:1787032207.110486:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787032207.110492:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857048832:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787032207.112449:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdffe09880 x1873838857049088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032207.112471:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857049088:0@lo:400:kworker.0 00000100:00100000:0.0:1787032207.112489:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857048960:0@lo:400:kworker.0 00000100:00100000:1.0:1787032207.113967:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857048832:12345-0@lo:400:kworker.0 Request processed in 3461us (3963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032207.113984:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787032207.114121:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857048832:0@lo:400:kworker.0 00000001:00080000:0.0:1787032207.192603:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1787032207.192629:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787032207.192660:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787032207.192844:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787032207.192872:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857049472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787032207.192978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032207.193049:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857049472 00000100:00100000:2.0:1787032207.193095:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857049472 00000100:00100000:2.0:1787032207.193178:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787032207.193188:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857049472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787032207.193290:0:6586:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787032207.193329:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a83f289, atime: 0x6a83f289, ctime: 0x6a83f289, blocks: 0x1 00010000:00010000:2.0:1787032207.193337:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032207.193354:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1787032207.193358:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032207.193365:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032207.193382:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032207.193393:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032207.193401:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032207.193437:0:6586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787032207.194761:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857049472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1569us (1778us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787032207.194775:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787032207.194814:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032207.194822:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032207.194835:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032207.194840:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032207.194852:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787032207.194873:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cde4872680/2, rc 0, transno 4294967300 00010000:00010000:2.0:1787032207.194874:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032207.194894:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1e9a84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032207.194896:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857049472:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787032207.194937:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032207.194939:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032207.194942:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787032207.255475:0:11483:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1787032207.617377:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032207.617403:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857049600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032207.617473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032207.617639:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787032207.617650:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857049728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032207.617680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032207.617719:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857049600 00000100:00100000:0.0:1787032207.617741:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857049600 00000100:00100000:0.0:1787032207.617789:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857049728 00000100:00100000:0.0:1787032207.617793:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857049728 00000100:00100000:0.0:1787032207.617810:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787032207.617818:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857049600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032207.617856:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032207.617904:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857049600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032207.617911:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787032207.617930:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787032207.617937:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857049728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032207.617972:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032207.618005:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857049728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032207.618011:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787032207.618054:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857049728:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787032207.618129:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4872a00 x1873838857049600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032207.618143:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857049600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787032208.065705:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787032208.251422:0:11531:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd38366c70 20000000:00000080:2.0:1787032208.251440:0:11531:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cdff555400 uarg=0000000000000000 20000000:01000000:2.0:1787032208.251479:0:11531:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787032208.251484:0:11531:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787032208.251488:0:11531:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787032208.252528:0:11532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787032208.252604:0:11531:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787032208.262489:0:11531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787032208.262553:0:11531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787032208.262635:0:11531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787032208.262655:0:11531:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787032208.262675:0:11531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262695:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262705:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262714:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262722:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262730:0:11531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262738:0:11531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262785:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262811:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 18 pid: 5791 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032208.262826:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857049856:0@lo:104: 00000100:00100000:2.0:1787032208.262891:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787032208.262957:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.262966:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 18 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032208.262976:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857049984:0@lo:104: 00000100:00100000:2.0:1787032208.262999:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787032208.263052:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.263061:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 18 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032208.263091:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857050112:0@lo:104: 00000100:00100000:2.0:1787032208.263117:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787032208.263146:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.263157:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 12 pid: 5792 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032208.263166:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857050240:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032208.263232:0:11531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032208.263240:0:11531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 12 pid: 5791 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032208.263249:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857050368:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032208.263271:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc33c3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032208.263297:0:5781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787032208.263312:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857049856 00000100:00100000:1.0:1787032208.263324:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857049856 00000100:00100000:1.0:1787032208.263361:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857049984 00000100:00100000:1.0:1787032208.263364:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857049984 00000100:00100000:1.0:1787032208.263374:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857050112 00000100:00100000:1.0:1787032208.263376:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857050112 00000100:00100000:1.0:1787032208.263389:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787032208.263396:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:11531:x1873838857049856:12345-0@lo:104: 00010000:00010000:1.0:1787032208.263409:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263471:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787032208.263477:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+5:11531:x1873838857049856:12345-0@lo:104: Request processed in 82us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032208.263484:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787032208.263500:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787032208.263506:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:11531:x1873838857049984:12345-0@lo:104: 00010000:00010000:1.0:1787032208.263513:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263544:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787032208.263549:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+4:11531:x1873838857049984:12345-0@lo:104: Request processed in 44us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032208.263554:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787032208.263567:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787032208.263583:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfac9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:11531:x1873838857050112:12345-0@lo:104: 00010000:00010000:1.0:1787032208.263591:0:5781:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032208.263608:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857049856:0@lo:104: 00010000:00010000:1.0:1787032208.263614:0:5781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787032208.263617:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857049984:0@lo:104: 00000100:00100000:1.0:1787032208.263623:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfac9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0402f217-6678-4505-97bf-ca0cb32c7313+3:11531:x1873838857050112:12345-0@lo:104: Request processed in 51us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032208.263624:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857050112:0@lo:104: 00000100:00100000:1.0:1787032208.263629:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787032208.263774:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787032208.263779:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263787:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032208.263791:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263799:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032208.263807:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032208.263813:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787032208.263851:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263857:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032208.263877:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263884:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdef419a00/0xcd047797ef1e9950 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9957 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263897:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787032208.263901:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263916:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419600 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032208.263920:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263926:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032208.263931:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032208.263936:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787032208.263949:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263955:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032208.263970:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263977:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdef419600/0xcd047797ef1e9942 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e9949 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263988:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032208.263991:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.263996:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774c00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032208.263998:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.264014:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032208.264020:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032208.264024:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787032208.264038:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.264043:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032208.264051:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.264056:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1e9934 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1e993b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.264098:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032208.264100:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032208.264102:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032208.264109:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787032208.264120:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857050496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032208.264150:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032208.264176:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857050752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032208.264198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032208.265872:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787032208.265887:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857050624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032208.265937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032208.265993:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857050496 00000100:00100000:1.0:1787032208.265999:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857050496 00010000:00010000:1.0:1787032208.266029:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 19 pid: 5791 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032208.266052:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857050752 00000100:00100000:1.0:1787032208.266055:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857050752 00010000:00010000:1.0:1787032208.266083:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 20 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032208.266096:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857050624 00000100:00100000:1.0:1787032208.266099:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857050624 00010000:00010000:1.0:1787032208.266111:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 21 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032208.266124:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787032208.266132:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+21:3302:x1873838857050496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787032208.266144:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032208.266150:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 21 pid: 5791 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266162:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 21 pid: 5791 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266181:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7774000/0xcd047797ef1e9957 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9950 expref: 21 pid: 5791 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266196:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032208.266296:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+20:3302:x1873838857050496:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032208.266303:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787032208.266327:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787032208.266334:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857050752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787032208.266341:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032208.266346:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 19 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266354:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 19 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266364:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef418e00/0xcd047797ef1e993b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9934 expref: 19 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266373:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032208.266401:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+18:3305:x1873838857050752:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032208.266408:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787032208.266421:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787032208.266427:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+17:3305:x1873838857050624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787032208.266434:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032208.266438:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 17 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266447:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 17 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266457:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7774200/0xcd047797ef1e9949 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1e9942 expref: 17 pid: 5790 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.266465:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032208.266495:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0402f217-6678-4505-97bf-ca0cb32c7313+16:3305:x1873838857050624:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032208.266501:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787032208.266614:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857050624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032208.266625:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857050752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032208.266747:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1787032208.266766:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032208.266840:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857050496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787032208.267398:0:7488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:1.0:1787032208.274055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032208.274110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032208.274156:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834996864 00000100:00100000:1.0:1787032208.274166:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834996864 00000100:00100000:3.0:1787032208.274329:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857050240:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032208.274343:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11531:1873838857050368:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032208.274376:0:11531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274425:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 13 pid: 5791 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032208.274462:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834996736 00000100:00100000:1.0:1787032208.274466:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834996736 00010000:00010000:1.0:1787032208.274481:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 14 pid: 5792 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032208.274497:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:1.0:1787032208.274505:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+14:2355:x1873838834996864:12345-192.168.201.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787032208.274509:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787032208.274517:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787032208.274519:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032208.274525:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 14 pid: 5791 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274535:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 14 pid: 5791 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274558:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef419c00/0xcd047797ef1e9926 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b273d expref: 14 pid: 5791 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274605:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032208.274661:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834996864:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 155us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032208.274668:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:1.0:1787032208.274687:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 34 00000100:00100000:1.0:1787032208.274693:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:2355:x1873838834996736:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032208.274701:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032208.274706:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 12 pid: 5792 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274715:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 12 pid: 5792 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274724:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6200/0xcd047797ef1e992d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2744 expref: 12 pid: 5792 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274734:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274742:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274753:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274759:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274776:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274782:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274788:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032208.274792:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274800:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274812:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032208.274822:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032208.274856:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:2355:x1873838834996736:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 162us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032208.274863:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 34 00010000:00010000:3.0:1787032208.275172:0:11531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032208.275180:0:11531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032208.275185:0:11531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6e00/0xcd047797ef1e9a8b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032209.089461:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032209.475515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032209.480492:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834996992 00000100:00100000:2.0:1787032209.480516:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834996992 00000100:00100000:2.0:1787032209.480697:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 248 00000100:00100000:2.0:1787032209.480710:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:5573:x1873838834996992:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032209.480735:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032209.480766:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e9a92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2791 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032209.480807:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e9a92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2791 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032209.480820:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e9a92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2791 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032209.480855:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6a00, rc 0) 00000100:00100000:2.0:1787032209.480955:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834996992:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 Request processed in 247us (5456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032209.480963:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 248 00000100:00100000:2.0:1787032209.493453:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032209.503506:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834997120 00000100:00100000:0.0:1787032209.503532:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834997120 00000100:00100000:0.0:1787032209.503716:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 249 00000100:00100000:0.0:1787032209.503730:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834997120:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032209.504276:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834997120:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 Request processed in 547us (10837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032209.504287:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 249 00000100:00100000:1.0:1787032209.510802:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032209.510930:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834997248 00000100:00100000:2.0:1787032209.510945:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834997248 00000100:00100000:2.0:1787032209.511033:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 250 00000100:00100000:2.0:1787032209.511046:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834997248:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032209.511884:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834997248:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 Request processed in 834us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032209.511897:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 250 00000100:00100000:1.0:1787032209.526542:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032209.526685:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834997376 00000100:00100000:0.0:1787032209.526699:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834997376 00000100:00100000:0.0:1787032209.526772:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 251 00000100:00100000:0.0:1787032209.526784:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:9926:x1873838834997376:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787032209.527364:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:9926:x1873838834997376:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 580us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032209.527376:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 251 00000100:00100000:1.0:1787032209.532448:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032209.540949:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834997504 00000100:00100000:2.0:1787032209.540975:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834997504 00000100:00100000:2.0:1787032209.542506:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 252 00000100:00100000:2.0:1787032209.542525:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:9926:x1873838834997504:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787032209.542953:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:9926:x1873838834997504:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 430us (10519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032209.542964:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 252 00000100:00100000:1.0:1787032209.553433:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032209.553769:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834997632 00000100:00100000:3.0:1787032209.553785:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834997632 00000100:00100000:3.0:1787032209.553866:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 253 00000100:00100000:3.0:1787032209.553879:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:5573:x1873838834997632:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032209.553902:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032209.553928:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418400/0xcd047797ef1e9a99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2798 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.553967:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418400/0xcd047797ef1e9a99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2798 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.553980:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418400/0xcd047797ef1e9a99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2798 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.553991:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418400, rc 0) 00000100:00100000:3.0:1787032209.554145:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834997632:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 Request processed in 267us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032209.554154:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 253 00000100:00100000:1.0:1787032209.566124:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032209.566297:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834997760 00000100:00100000:0.0:1787032209.566315:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834997760 00000100:00100000:0.0:1787032209.566408:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 254 00000100:00100000:0.0:1787032209.566422:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834997760:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032209.566857:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834997760:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 Request processed in 436us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032209.566867:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 254 00000100:00100000:1.0:1787032209.587403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032209.587563:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834997888 00000100:00100000:2.0:1787032209.587577:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834997888 00000100:00100000:2.0:1787032209.587652:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 255 00000100:00100000:2.0:1787032209.587665:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834997888:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032209.588000:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:5573:x1873838834997888:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 Request processed in 335us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032209.588030:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 255 00000100:00100000:1.0:1787032209.594385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032209.594951:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834998016 00000100:00100000:3.0:1787032209.594965:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834998016 00000100:00100000:3.0:1787032209.595048:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 256 00000100:00100000:3.0:1787032209.595061:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:9929:x1873838834998016:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787032209.595433:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:9929:x1873838834998016:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 374us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032209.595443:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 256 00000100:00100000:1.0:1787032209.604799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032209.604919:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834998144 00000100:00100000:0.0:1787032209.604932:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834998144 00000100:00100000:0.0:1787032209.605015:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 257 00000100:00100000:0.0:1787032209.605035:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:9929:x1873838834998144:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787032209.605421:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:9929:x1873838834998144:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 388us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032209.605431:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 257 10000000:01000000:2.0:1787032209.794253:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787032209.794264:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdc4c91800 from 7 10000000:01000000:2.0:1787032209.794271:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787032209.794341:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032209.794355:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032209.794369:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032209.794402:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857050880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787032209.794503:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032209.794621:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032209.795041:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857050880 00000100:00100000:1.0:1787032209.795052:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857050880 00000100:00100000:1.0:1787032209.795159:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787032209.795171:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+16:5794:x1873838857050880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032209.796328:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032209.796372:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774e00/0xcd047797ef1e9aa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9aa0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032209.796427:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774e00/0xcd047797ef1e9aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9aa0 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032209.796444:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774e00/0xcd047797ef1e9aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9aa0 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032209.796457:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774e00, rc 0) 00000100:00100000:1.0:1787032209.796606:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857050880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1435us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032209.796616:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787032209.797586:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857050880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032209.797618:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032209.797631:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032209.797754:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032209.797821:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032209.797946:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787032209.806279:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857051008 00000100:00100000:3.0:1787032209.806305:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857051008 00000100:00100000:3.0:1787032209.806400:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787032209.806414:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857051008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032209.807496:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857051008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1077us (9667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032209.807510:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787032209.811401:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032209.813725:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032209.813940:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032209.814023:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032209.814277:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857051136 00000100:00100000:1.0:1787032209.814288:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857051136 00000100:00100000:1.0:1787032209.814417:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787032209.814431:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857051136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032209.814741:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857051136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 312us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032209.814751:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787032209.816718:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032209.819463:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11545:1873838857051264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032209.820433:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032209.820606:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf4a86480 going to sleep for 11 seconds 00000100:00100000:3.0:1787032209.821910:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857051264 00000100:00100000:3.0:1787032209.821927:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857051264 00000100:00100000:3.0:1787032209.822369:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787032209.822383:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:11545:x1873838857051264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032209.822757:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+17:11545:x1873838857051264:12345-0@lo:502:llog_process_th.0 Request processed in 375us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032209.822765:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787032209.822894:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11545:1873838857051264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787032209.822949:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787032209.822961:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032209.822964:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787032209.822971:0:11545:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cdc4c91800 00000020:00000080:1.0:1787032209.822974:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787032209.823167:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11545:1873838857051392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032209.823809:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032209.832338:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857051392 00000100:00100000:0.0:1787032209.832361:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857051392 00000100:00100000:0.0:1787032209.832441:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787032209.832454:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:11545:x1873838857051392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032209.832832:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:11545:x1873838857051392:12345-0@lo:502:llog_process_th.0 Request processed in 379us (9024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032209.832843:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787032209.833651:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc33c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787032209.833690:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11545:1873838857051392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787032209.833743:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032209.833753:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032209.833756:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787032209.833761:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787032209.833951:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787032209.833975:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787032209.833986:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032209.833999:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032209.834012:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787032209.835797:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdefa84800 from 7 10000000:01000000:0.0:1787032209.835811:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787032209.835870:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032209.835885:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032209.835913:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032209.835946:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787032209.836668:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032209.836718:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc33c3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787032209.836739:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857051520 00000100:00100000:3.0:1787032209.836752:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857051520 00000100:00100000:3.0:1787032209.836880:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787032209.836891:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+17:5794:x1873838857051520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032209.836911:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032209.836928:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef419800/0xcd047797ef1e9ab5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9aae expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.836961:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef419800/0xcd047797ef1e9ab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9aae expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.836972:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef419800/0xcd047797ef1e9ab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9aae expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.836983:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419800, rc 0) 00000100:00100000:3.0:1787032209.837050:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857051520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032209.837087:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787032209.838155:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032209.838313:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.838328:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032209.838425:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032209.838487:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032209.842494:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787032209.846025:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857051648 00000100:00100000:1.0:1787032209.846048:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857051648 00000100:00100000:1.0:1787032209.846254:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787032209.846268:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857051648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032209.847010:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857051648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 742us (8518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032209.847534:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787032209.847695:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032209.848275:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032209.848446:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032209.848660:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032209.849353:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857051776 00000100:00100000:0.0:1787032209.849365:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857051776 00000100:00100000:0.0:1787032209.849440:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787032209.849829:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857051776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787032209.854405:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857051776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4940us (5943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032209.854424:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787032209.855904:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857051776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032209.856582:0:11548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11548:1873838857051904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032209.856686:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032209.856738:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857051904 00000100:00100000:3.0:1787032209.856746:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857051904 00000100:00100000:3.0:1787032209.856805:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787032209.856817:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:11548:x1873838857051904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032209.861142:0:11548:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787032209.862694:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:11548:x1873838857051904:12345-0@lo:502:llog_process_th.0 Request processed in 5865us (5995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032209.862711:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787032209.864371:0:11548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11548:1873838857051904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787032209.864682:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032209.864700:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032209.864703:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787032209.864713:0:11548:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cdefa84800 00000020:00000080:0.0:1787032209.864716:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787032209.866817:0:11548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11548:1873838857052032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032209.866950:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032209.867011:0:11548:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc33c39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032209.869968:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857052032 00000100:00100000:1.0:1787032209.869990:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857052032 00000100:00100000:1.0:1787032209.870124:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787032209.870148:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:11548:x1873838857052032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032209.870718:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+18:11548:x1873838857052032:12345-0@lo:502:llog_process_th.0 Request processed in 571us (3767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032209.870742:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787032209.872440:0:11548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11548:1873838857052032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787032209.872514:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032209.872527:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032209.872530:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787032209.872536:0:11548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787032209.872850:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787032209.872882:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787032209.872898:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032209.872925:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032209.872939:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787032209.872943:0:5794:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cde4b73800 from 7 10000000:01000000:0.0:1787032209.872947:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787032209.873001:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032209.873010:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032209.873021:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032209.873050:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857052160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787032209.873180:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032209.873409:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc33c39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032209.873832:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857052160 00000100:00100000:3.0:1787032209.873842:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857052160 00000100:00100000:3.0:1787032209.873910:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787032209.873921:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+18:5794:x1873838857052160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032209.873938:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032209.873956:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418600/0xcd047797ef1e9ac3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1e9abc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.873997:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418600/0xcd047797ef1e9ac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1e9abc expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.874009:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418600/0xcd047797ef1e9ac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1e9abc expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032209.874036:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418600, rc 0) 00000100:00100000:3.0:1787032209.874123:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857052160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032209.874130:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787032209.874849:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857052160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787032209.874872:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032209.874885:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032209.874970:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857052288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032209.876809:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032209.876926:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc33c39c0 going to sleep for 11 seconds 00000040:00080000:2.0:1787032209.884972:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787032209.895857:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857052288 00000100:00100000:1.0:1787032209.895878:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857052288 00000100:00100000:1.0:1787032209.895998:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787032209.896012:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857052288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032209.896518:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857052288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 506us (19715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032209.896528:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787032209.897176:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857052288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787032209.897369:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857052416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787032209.897434:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032209.897552:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc613a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032209.900252:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857052416 00000100:00100000:1.0:1787032209.900271:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857052416 00000100:00100000:1.0:1787032209.900565:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787032209.900582:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857052416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032209.900959:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:5794:x1873838857052416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 379us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032209.900967:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787032209.901057:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0402f217-6678-4505-97bf-ca0cb32c7313:5794:1873838857052416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032209.902828:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11551:1873838857052544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032209.902926:0:11551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032209.902971:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857052544 00000100:00100000:1.0:1787032209.902978:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857052544 00000100:00100000:1.0:1787032209.903023:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787032209.903033:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:11551:x1873838857052544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032209.905713:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc2f50000 going to sleep for 11 seconds 00000100:00100000:1.0:1787032209.907426:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:11551:x1873838857052544:12345-0@lo:502:llog_process_th.0 Request processed in 4383us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032209.907596:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11551:1873838857052544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787032209.907656:0:11551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032209.907668:0:11551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032209.907671:0:11551:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787032209.907679:0:11551:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cde4b73800 00000020:00000080:0.0:1787032209.907682:0:11551:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787032209.908565:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787032209.908867:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11551:1873838857052672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032209.908965:0:11551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032209.909007:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc33c3780 going to sleep for 11 seconds 00000100:00100000:1.0:1787032209.909112:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857052672 00000100:00100000:1.0:1787032209.909121:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857052672 00000100:00100000:1.0:1787032209.909725:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787032209.909738:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:11551:x1873838857052672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032209.911892:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:11551:x1873838857052672:12345-0@lo:502:llog_process_th.0 Request processed in 2142us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032209.911911:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787032209.912141:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0402f217-6678-4505-97bf-ca0cb32c7313:11551:1873838857052672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787032209.912411:0:11551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032209.912425:0:11551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032209.912427:0:11551:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787032209.912433:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787032209.913394:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787032209.913425:0:5794:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787032209.913440:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032209.913584:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032210.053897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032210.053953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032210.054007:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032210.054056:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032210.054163:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834998528 00000100:00100000:1.0:1787032210.054175:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834998528 00000100:00100000:1.0:1787032210.054272:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:1.0:1787032210.054296:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834998528:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032210.054390:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834998528:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 97us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032210.054399:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00080000:1.0:1787032210.054426:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032210.055662:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834998272 00000100:00100000:0.0:1787032210.055675:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834998272 00000100:00100000:0.0:1787032210.055743:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 273 00000100:00100000:0.0:1787032210.055754:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834998272:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032210.055839:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834998272:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 87us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032210.055868:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 273 00000100:00100000:2.0:1787032210.056884:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834998400 00000100:00100000:2.0:1787032210.056895:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834998400 00000100:00100000:2.0:1787032210.056968:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834998656 00000100:00100000:2.0:1787032210.056971:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834998656 00000100:00100000:2.0:1787032210.057002:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 105 00000100:00100000:2.0:1787032210.057019:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834998400:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032210.057153:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834998400:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 142us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032210.057161:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 105 00000100:00100000:2.0:1787032210.057178:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 106 00000100:00100000:2.0:1787032210.057195:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834998656:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032210.057223:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834998656:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 39us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032210.057230:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 106 00000100:00080000:0.0:1787032210.059006:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787032210.113834:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787032210.947946:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787032211.137321:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032212.163494:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032212.228673:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857052800:0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.228773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032212.228810:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857052928:0@lo:400:kworker.0 00000100:00100000:0.0:1787032212.228849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032212.228851:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857053312:0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.228874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032212.228874:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857053440:0@lo:400:kworker.0 00000100:00100000:0.0:1787032212.228898:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032212.228909:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857053184:0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.228934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032212.228972:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857053440 00000100:00100000:1.0:1787032212.228982:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857053440 00000100:00100000:1.0:1787032212.229043:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857053184 00000100:00100000:1.0:1787032212.229046:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857053184 00000100:00100000:1.0:1787032212.229099:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787032212.229109:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857053440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.229171:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857053440:12345-0@lo:400:kworker.0 Request processed in 62us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032212.229178:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787032212.229197:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787032212.229203:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857053184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.229236:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857053184:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032212.229241:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787032212.229287:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef002300 x1873838857053184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032212.229304:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857053184:0@lo:400:kworker.0 00000100:00080000:1.0:1787032212.229329:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787032212.229333:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787032212.229350:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857053440:0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.229384:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857052928 00000100:00100000:1.0:1787032212.229387:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857052928 00000100:00100000:1.0:1787032212.229419:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857053312 00000100:00100000:1.0:1787032212.229422:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857053312 00000100:00100000:1.0:1787032212.229440:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787032212.229446:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857052928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.229478:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857052928:12345-0@lo:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032212.229484:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787032212.229493:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787032212.229511:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857053312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.229541:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857053312:12345-0@lo:400:kworker.0 Request processed in 42us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032212.229547:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787032212.229566:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857052800 00000100:00100000:1.0:1787032212.229569:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857052800 00000100:00100000:1.0:1787032212.229594:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787032212.229600:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857052800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.229631:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857052800:12345-0@lo:400:kworker.0 Request processed in 30us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032212.229638:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787032212.229678:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857052800:0@lo:400:kworker.0 00000100:00100000:1.0:1787032212.229688:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857053312:0@lo:400:kworker.0 00000100:00080000:1.0:1787032212.229705:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032212.229717:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857052928:0@lo:400:kworker.0 00000100:00100000:0.0:1787032212.229957:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857053056:0@lo:400:kworker.0 00000100:00100000:0.0:1787032212.229995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032212.233973:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857053056 00000100:00100000:0.0:1787032212.233994:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857053056 00000100:00100000:0.0:1787032212.234120:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787032212.234131:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857053056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032212.234266:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857053056:12345-0@lo:400:kworker.0 Request processed in 138us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032212.234274:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787032212.234339:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857053056:0@lo:400:kworker.0 00000100:00080000:3.0:1787032212.234908:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1787032212.278886:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1787032212.737694:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787032212.738606:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032212.738641:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857053696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032212.738771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032212.741864:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857053696 00000100:00100000:0.0:1787032212.741886:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857053696 00000100:00100000:0.0:1787032212.742000:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787032212.742016:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857053696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032212.742118:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032212.742256:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857053696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 242us (3482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032212.742288:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787032212.742297:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787032212.742307:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cde4872680, transno 4294967300 00000100:00100000:1.0:1787032212.742340:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857053696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032212.748143:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857053568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032212.748327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032212.749144:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857053568 00000100:00100000:0.0:1787032212.749159:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857053568 00000100:00100000:1.0:1787032212.749268:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787032212.749287:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857053568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032212.749346:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032212.749434:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857053568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032212.749443:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787032212.749553:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4873100 x1873838857053568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032212.749577:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857053568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787032213.185417:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032214.209346:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032215.171159:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032215.171221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032215.171286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032215.171335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032215.171376:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834999040 00000100:00100000:1.0:1787032215.171389:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834999040 00000100:00100000:0.0:1787032215.171459:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834998784 00000100:00100000:0.0:1787032215.171463:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834998784 00000100:00100000:1.0:1787032215.171487:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:0.0:1787032215.171493:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 275 00000100:00100000:1.0:1787032215.171499:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834999040:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032215.171499:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834998784:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032215.171619:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834998912 00000100:00100000:2.0:1787032215.171626:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834998912 00000100:00100000:2.0:1787032215.171678:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834999168 00000100:00100000:2.0:1787032215.171681:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834999168 00000100:00100000:2.0:1787032215.171713:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 110 00000100:00100000:2.0:1787032215.171725:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834998912:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032215.171812:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838834998784:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 311us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032215.171821:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 275 00000100:00100000:3.0:1787032215.171833:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 111 00000100:00100000:3.0:1787032215.171848:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834999168:12345-192.168.201.48@tcp:400:kworker.0 00000100:00080000:0.0:1787032215.171910:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032215.171927:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787032215.176271:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834999040:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 4453us (4614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032215.176294:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:3.0:1787032215.176648:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838834999168:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 4802us (5422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032215.176661:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 111 00000100:00100000:2.0:1787032215.184801:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838834998912:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 13056us (13636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032215.184824:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 110 00010000:00010000:1.0:1787032215.233651:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032216.258342:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032217.284639:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032217.345626:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857054208:0@lo:400:kworker.0 00000100:00100000:2.0:1787032217.345725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032217.345829:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787032217.345839:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857053952:0@lo:400:kworker.0 00000100:00100000:2.0:1787032217.345842:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857054080:0@lo:400:kworker.0 00000100:00100000:3.0:1787032217.345924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032217.345967:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857054464:0@lo:400:kworker.0 00000100:00100000:3.0:1787032217.345994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032217.346029:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787032217.346053:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857053824:0@lo:400:kworker.0 00000100:00100000:1.0:1787032217.346167:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857054208 00000100:00100000:1.0:1787032217.346179:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857054208 00000100:00100000:1.0:1787032217.346263:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857054464 00000100:00100000:1.0:1787032217.346267:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857054464 00000100:00100000:1.0:1787032217.346294:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787032217.346304:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857054208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032217.346371:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857054208:12345-0@lo:400:kworker.0 Request processed in 68us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032217.346379:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787032217.346397:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787032217.346404:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857054464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032217.346448:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857054464:12345-0@lo:400:kworker.0 Request processed in 45us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032217.346454:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1787032217.346477:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787032217.346481:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032217.347101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787032217.347154:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdfb31f480 x1873838857054208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032217.347174:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857054208:0@lo:400:kworker.0 00000100:00100000:2.0:1787032217.347208:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857053952 00000100:00100000:2.0:1787032217.347212:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857053952 00000100:00100000:3.0:1787032217.352295:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032217.352358:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857054336:0@lo:400:kworker.0 00000100:00100000:3.0:1787032217.352388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032217.354666:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857053824 00000100:00100000:0.0:1787032217.354692:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857053824 00000100:00100000:0.0:1787032217.354766:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787032217.354779:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857053824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032217.354939:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857053824:12345-0@lo:400:kworker.0 Request processed in 163us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032217.354948:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787032217.364767:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857054080 00000100:00100000:3.0:1787032217.364823:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857054336 00000100:00100000:3.0:1787032217.364839:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857054336 00000100:00100000:3.0:1787032217.364920:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787032217.364934:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857053952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032217.365013:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857053952:12345-0@lo:400:kworker.0 Request processed in 84us (19089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032217.365021:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787032217.365056:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787032217.365062:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857054336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032217.365109:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857054336:12345-0@lo:400:kworker.0 Request processed in 47us (12720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032217.365115:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1787032217.365133:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032217.365169:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857054336:0@lo:400:kworker.0 00000100:00100000:3.0:1787032217.365182:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857053952:0@lo:400:kworker.0 00000100:00100000:3.0:1787032217.365195:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857054464:0@lo:400:kworker.0 00000100:00100000:3.0:1787032217.365223:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857053824:0@lo:400:kworker.0 00000100:00100000:2.0:1787032217.365337:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857054080 00000100:00100000:2.0:1787032217.365453:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787032217.365465:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857054080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787032217.365620:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032217.365697:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857054080:12345-0@lo:400:kworker.0 Request processed in 234us (18594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032217.365708:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787032217.365809:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857054080:0@lo:400:kworker.0 00000100:00100000:0.0:1787032217.858091:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857054592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032217.858181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032217.858333:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857054592 00000100:00100000:2.0:1787032217.858343:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857054592 00000100:00100000:2.0:1787032217.858413:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787032217.858424:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857054592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032217.858462:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032217.858511:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857054592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032217.858518:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787032217.858626:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857054592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032217.859096:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032217.859108:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857054720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032217.859145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032217.859311:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857054720 00000100:00100000:1.0:1787032217.859317:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857054720 00000100:00100000:1.0:1787032217.859358:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787032217.859366:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857054720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032217.859391:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032217.859446:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857054720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032217.859453:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787032217.859488:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4870a80 x1873838857054720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032217.859504:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857054720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787032218.305692:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032219.329402:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787032220.163147:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787032220.290605:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032220.290666:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032220.290707:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032220.290744:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032220.290774:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834999552 00000100:00100000:1.0:1787032220.290784:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834999552 00000100:00100000:1.0:1787032220.290848:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 66 00000100:00100000:0.0:1787032220.290855:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834999424 00000100:00100000:1.0:1787032220.290857:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838834999552:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032220.290865:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834999424 00000100:00100000:0.0:1787032220.290894:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834999680 00000100:00100000:0.0:1787032220.290897:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834999680 00000100:00100000:0.0:1787032220.290917:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 115 00000100:00100000:0.0:1787032220.290925:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838834999424:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032220.290933:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838834999552:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032220.290953:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838834999424:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032220.290960:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 115 00000100:00100000:0.0:1787032220.290974:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 116 00000100:00100000:0.0:1787032220.290980:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834999680:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032220.291155:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838834999680:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 174us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032220.291163:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 116 00000100:00080000:2.0:1787032220.291278:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787032220.291284:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032220.291375:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834999296 00000100:00100000:3.0:1787032220.291380:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834999296 00000100:00100000:3.0:1787032220.291415:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 277 00000100:00100000:3.0:1787032220.291429:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834999296:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032220.291527:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834999296:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 98us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032220.291534:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 277 00000100:00100000:1.0:1787032220.301759:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 66 00010000:00010000:0.0:1787032220.355098:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032221.377937:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032222.402941:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032222.467660:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857055104:0@lo:400:kworker.0 00000100:00100000:1.0:1787032222.467744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032222.467810:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032222.467818:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857055232:0@lo:400:kworker.0 00000100:00100000:1.0:1787032222.467844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032222.467881:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857055232 00000100:00100000:1.0:1787032222.467887:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857055232 00000100:00100000:1.0:1787032222.467946:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787032222.467956:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857055232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032222.467958:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857054976:0@lo:400:kworker.0 00000100:00100000:0.0:1787032222.467987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032222.468001:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857055232:12345-0@lo:400:kworker.0 Request processed in 47us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032222.468003:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857055488:0@lo:400:kworker.0 00000100:00100000:1.0:1787032222.468009:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787032222.468021:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787032222.468061:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032222.468105:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857055104 00000100:00100000:2.0:1787032222.468110:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857055104 00000100:00100000:2.0:1787032222.468141:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857054976 00000100:00100000:2.0:1787032222.468144:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857054976 00000100:00100000:2.0:1787032222.468163:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787032222.468169:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857055104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032222.468202:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857055104:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032222.468208:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787032222.468221:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787032222.468227:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857054976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032222.468292:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857054976:12345-0@lo:400:kworker.0 Request processed in 64us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032222.468327:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787032222.468393:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857055488 00000100:00100000:1.0:1787032222.468397:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857055488 00000100:00100000:3.0:1787032222.468417:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857054848:0@lo:400:kworker.0 00000100:00100000:1.0:1787032222.468422:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787032222.468427:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857055488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032222.468450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032222.468474:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857055360:0@lo:400:kworker.0 00000100:00100000:1.0:1787032222.468474:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857055488:12345-0@lo:400:kworker.0 Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032222.468480:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787032222.468494:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787032222.468519:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdffe09880 x1873838857055232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032222.468533:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857055232:0@lo:400:kworker.0 00000100:00100000:2.0:1787032222.468569:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857055360 00000100:00100000:2.0:1787032222.468574:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857055360 00000100:00100000:2.0:1787032222.468597:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787032222.468602:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857055360:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787032222.469299:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787032222.469304:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032222.469505:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857054848 00000100:00100000:3.0:1787032222.469510:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857054848 00000100:00100000:3.0:1787032222.469540:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787032222.469546:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857054848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032222.469593:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857054848:12345-0@lo:400:kworker.0 Request processed in 48us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032222.469599:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787032222.469654:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857054848:0@lo:400:kworker.0 00000100:00100000:1.0:1787032222.474022:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857055104:0@lo:400:kworker.0 00000100:00100000:0.0:1787032222.475170:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857055488:0@lo:400:kworker.0 00000100:00100000:0.0:1787032222.475207:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857054976:0@lo:400:kworker.0 00000100:00100000:2.0:1787032222.476592:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857055360:12345-0@lo:400:kworker.0 Request processed in 7981us (8088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032222.476616:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787032222.478573:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857055360:0@lo:400:kworker.0 00000100:00100000:3.0:1787032222.977432:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787032222.977457:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857055616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032222.977536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032222.977935:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857055616 00000100:00100000:0.0:1787032222.977943:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857055616 00000100:00100000:0.0:1787032222.977998:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787032222.978009:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857055616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032222.978059:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032222.978144:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857055616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032222.978164:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787032222.978385:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857055616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032222.978625:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032222.987288:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857055744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032222.987394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032222.987565:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857055744 00000100:00100000:0.0:1787032222.987573:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857055744 00000100:00100000:0.0:1787032222.987629:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787032222.987639:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857055744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032222.987679:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032222.987738:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857055744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032222.987755:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787032222.987891:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4870a80 x1873838857055744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032222.987926:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857055744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787032223.430357:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032224.449874:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032225.418985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032225.419137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032225.419717:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834999808 00000100:00100000:0.0:1787032225.419729:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834999808 00000100:00100000:0.0:1787032225.419800:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 279 00000100:00100000:0.0:1787032225.419810:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834999808:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032225.419902:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838834999808:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 93us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032225.419909:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 279 00000100:00100000:3.0:1787032225.423518:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838834999936 00000100:00100000:3.0:1787032225.423538:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838834999936 00000100:00100000:3.0:1787032225.423661:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 120 00000100:00100000:3.0:1787032225.423687:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838834999936:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032225.423804:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838834999936:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 133us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032225.423812:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 120 00000100:00100000:1.0:1787032225.425748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00080000:2.0:1787032225.425950:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032225.426015:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835000064 00000100:00100000:3.0:1787032225.426026:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835000064 00000100:00100000:3.0:1787032225.426137:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:3.0:1787032225.426148:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2353:x1873838835000064:12345-192.168.201.48@tcp:9:kworker.0 00000020:00000080:3.0:1787032225.426191:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e99ff 00000100:00080000:3.0:1787032225.426202:0:6584:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e33000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787032225.426240:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787032225.426562:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+2:2353:x1873838835000064:12345-192.168.201.48@tcp:9:kworker.0 Request processed in 416us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032225.426688:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 20 00010000:00010000:0.0:1787032225.426994:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787032225.427050:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032225.427191:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032225.427689:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835000192 00000100:00100000:3.0:1787032225.427695:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835000192 00000100:00100000:3.0:1787032225.427761:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 121 00000100:00100000:3.0:1787032225.427770:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2356:x1873838835000192:12345-192.168.201.48@tcp:400:kworker.0 00000100:00080000:2.0:1787032225.427888:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032225.428019:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2356:x1873838835000192:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 247us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032225.428041:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 121 00010000:00010000:0.0:1787032225.473914:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032226.498785:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032227.521395:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032227.585530:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857056256:0@lo:400:kworker.0 00000100:00100000:0.0:1787032227.585604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032227.585700:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787032227.585707:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857056128:0@lo:400:kworker.0 00000100:00100000:0.0:1787032227.585750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032227.585790:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857056128 00000100:00100000:1.0:1787032227.586012:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857056000:0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032227.586063:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857056512:0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032227.586133:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787032227.586139:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857055872:0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586166:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032227.586188:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857056384:0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586207:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032227.586251:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857056000 00000100:00100000:1.0:1787032227.586263:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857056000 00000100:00100000:1.0:1787032227.586307:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857056384 00000100:00100000:1.0:1787032227.586310:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857056384 00000100:00100000:1.0:1787032227.586335:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787032227.586343:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857056000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586409:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873838857056000:12345-0@lo:400:kworker.0 Request processed in 66us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032227.586417:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787032227.586436:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787032227.586442:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857056384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586469:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857056384:12345-0@lo:400:kworker.0 Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032227.586475:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787032227.586494:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857056256 00000100:00100000:1.0:1787032227.586498:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857056256 00000100:00100000:1.0:1787032227.586522:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857056512 00000100:00100000:1.0:1787032227.586525:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857056512 00000100:00100000:1.0:1787032227.586544:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787032227.586550:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857056256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586583:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857056256:12345-0@lo:400:kworker.0 Request processed in 34us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032227.586590:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787032227.586601:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787032227.586607:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857056512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586633:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857056512:12345-0@lo:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032227.586639:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787032227.586665:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857055872 00000100:00100000:1.0:1787032227.586669:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857055872 00000100:00100000:1.0:1787032227.586708:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787032227.586714:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.586744:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857055872:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032227.586751:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787032227.587045:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857055872:0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.587063:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857056384:0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.587100:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873838857056000:0@lo:400:kworker.0 00000100:00100000:1.0:1787032227.587109:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857056512:0@lo:400:kworker.0 00010000:00080000:1.0:1787032227.587166:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4870700 x1873838857056256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032227.587177:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857056256:0@lo:400:kworker.0 00000100:00100000:0.0:1787032227.587320:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857056128 00000100:00100000:0.0:1787032227.587363:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787032227.587371:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857056128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032227.587414:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857056128:12345-0@lo:400:kworker.0 Request processed in 44us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032227.587420:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787032227.587448:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857056128:0@lo:400:kworker.0 00000100:00080000:2.0:1787032227.588054:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032227.588060:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032227.588063:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1787032227.692832:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:2.0:1787032227.692841:0:7500:0:(genops.c:906:class_export_put()) final put ffff99cdc4e36000/5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:0.0:1787032227.694016:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdc4e36000/5d144536-0f5d-43dc-8f25-f68546215872 for lustre-OST0001 00000020:00000080:0.0:1787032227.694267:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdc4e33000 for lustre-OST0001 00000100:00100000:1.0:1787032228.098397:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857056768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032228.098471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032228.098557:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787032228.098565:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857056640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032228.098591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032228.099122:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857056768 00000100:00100000:0.0:1787032228.099131:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857056768 00000100:00100000:0.0:1787032228.099195:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857056640 00000100:00100000:0.0:1787032228.099198:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857056640 00000100:00100000:0.0:1787032228.099229:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787032228.099238:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857056768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032228.099279:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032228.099350:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857056768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032228.099358:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787032228.099377:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787032228.099382:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857056640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032228.099401:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032228.099429:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857056640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032228.099448:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787032228.099658:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdff5a0700 x1873838857056640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032228.099679:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857056640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032228.099694:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857056768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787032228.556263:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032229.576565:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787032230.406892:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787032230.530351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032230.531213:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032230.531498:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835000320 00000100:00100000:0.0:1787032230.531509:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835000320 00000100:00100000:0.0:1787032230.531616:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 281 00000100:00100000:0.0:1787032230.531627:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835000320:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032230.531702:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835000320:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 76us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032230.531709:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 281 00000100:00100000:2.0:1787032230.532392:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835000576 00000100:00100000:2.0:1787032230.532399:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835000576 00000100:00080000:0.0:1787032230.532439:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032230.532450:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 125 00000100:00100000:2.0:1787032230.532459:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838835000576:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032230.532513:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838835000576:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 56us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032230.532520:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 125 00000100:00100000:3.0:1787032230.538046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032230.538437:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835000448 00000100:00100000:1.0:1787032230.538447:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835000448 00000100:00100000:1.0:1787032230.538518:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 126 00000100:00100000:1.0:1787032230.538529:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2356:x1873838835000448:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032230.538625:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2356:x1873838835000448:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 98us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032230.538633:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 126 00000100:00080000:2.0:1787032230.539225:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787032230.593270:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032231.618233:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787032232.161876:0:11716:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:50:30 (1787032230) 00010000:00010000:1.0:1787032232.644230:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032232.705589:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857056896:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.705665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032232.705717:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857057408:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.705744:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032232.705772:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787032232.705778:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857057024:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.705800:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032232.705818:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857057536:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.705840:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032232.705867:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857057152:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.705891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032232.705907:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032232.705912:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857057280:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.705953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032232.705987:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857056896 00000100:00100000:1.0:1787032232.705995:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857056896 00000100:00100000:1.0:1787032232.706039:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787032232.706047:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857056896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.706115:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857056896:12345-0@lo:400:kworker.0 Request processed in 69us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032232.706143:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787032232.706175:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857057408 00000100:00100000:1.0:1787032232.706179:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857057408 00000100:00100000:1.0:1787032232.706210:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857057024 00000100:00100000:1.0:1787032232.706213:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857057024 00000100:00100000:1.0:1787032232.706225:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857057152 00000100:00100000:1.0:1787032232.706228:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857057152 00000100:00100000:1.0:1787032232.706243:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787032232.706249:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857057408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.706282:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857057408:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032232.706289:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787032232.706302:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787032232.706308:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857057024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.706335:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857057024:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032232.706340:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787032232.706359:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787032232.706366:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857057152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032232.706414:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857057536 00000100:00100000:0.0:1787032232.706419:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857057536 00000100:00100000:1.0:1787032232.706493:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857057152:12345-0@lo:400:kworker.0 Request processed in 126us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032232.706499:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787032232.706544:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857057152:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.706571:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857057024:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.706580:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857056896:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.706599:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857057408:0@lo:400:kworker.0 00000100:00080000:2.0:1787032232.713379:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032232.713390:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032232.717418:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857057280 00000100:00100000:0.0:1787032232.717434:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857057280 00000100:00080000:2.0:1787032232.717551:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787032232.725426:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787032232.725448:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857057536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.725557:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857057536:12345-0@lo:400:kworker.0 Request processed in 117us (19715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032232.725565:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787032232.725590:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787032232.725599:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857057280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032232.725629:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857057536:0@lo:400:kworker.0 00000100:00100000:1.0:1787032232.725633:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857057280:12345-0@lo:400:kworker.0 Request processed in 36us (19680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032232.725638:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1787032232.725667:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cde4871c00 x1873838857057280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787032248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032232.725679:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857057280:0@lo:400:kworker.0 00000100:00100000:1.0:1787032233.217737:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857057664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032233.217825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032233.217958:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857057664 00000100:00100000:2.0:1787032233.217966:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857057664 00000100:00100000:2.0:1787032233.218022:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787032233.218033:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857057664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032233.218099:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032233.218160:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857057664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032233.218167:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787032233.218376:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857057664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032233.218394:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032233.218400:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857057792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032233.218440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032233.218513:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857057792 00000100:00100000:0.0:1787032233.218518:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857057792 00000100:00100000:0.0:1787032233.218553:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787032233.218560:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857057792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032233.218580:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032233.218622:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857057792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032233.218628:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787032233.219023:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdff5a2a00 x1873838857057792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032233.219039:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857057792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787032233.665378:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032233.821535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032233.821657:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835000704 00000100:00100000:1.0:1787032233.821666:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835000704 00000100:00100000:1.0:1787032233.821758:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00100000:1.0:1787032233.821768:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:10196:x1873838835000704:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787032233.821787:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032233.821810:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9aca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b279f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032233.821874:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ad1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032233.821889:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032233.821904:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032233.822164:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787032233.822168:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032233.822266:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032233.822295:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b279f expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032233.822314:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b279f expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032233.822323:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032233.822333:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787032233.822337:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775c00, rc 0) 00000100:00100000:1.0:1787032233.822408:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:10196:x1873838835000704:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 641us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032233.822416:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00080000:2.0:1787032233.823397:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032233.828540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032233.828689:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835000832 00000100:00100000:2.0:1787032233.828715:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835000832 00000100:00100000:2.0:1787032233.828780:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:2.0:1787032233.828789:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:10197:x1873838835000832:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032233.828814:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032233.828837:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9ad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27a6 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.828902:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.828917:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.828929:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.828943:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.828968:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.828975:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829407:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7a00/0xcd047797ef1e9aed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829419:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7a00/0xcd047797ef1e9aed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829427:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7a00/0xcd047797ef1e9aed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032233.829505:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787032233.829509:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032233.829600:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7a00/0xcd047797ef1e9aed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829612:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829618:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829625:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829631:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032233.829635:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829649:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829661:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032233.829665:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032233.829670:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829677:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829689:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829695:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829700:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829705:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032233.829708:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829714:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829721:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99cdc3864500) 00010000:00010000:2.0:1787032233.829724:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032233.829727:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829741:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9ae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829774:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9ad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27a6 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829787:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7a00/0xcd047797ef1e9aed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27a6 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.829795:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cdc3864100) 00010000:00010000:2.0:1787032233.829797:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032233.829800:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7a00, rc 0) 00000100:00100000:2.0:1787032233.829866:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:10197:x1873838835000832:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 1077us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032233.829875:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:0.0:1787032233.842852:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032233.843190:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835001088 00000100:00100000:2.0:1787032233.843200:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835001088 00000100:00100000:2.0:1787032233.843261:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 34 00000100:00100000:2.0:1787032233.843271:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:10197:x1873838835001088:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032233.843290:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032233.843311:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9af4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27ad expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.843380:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.843394:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.843411:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.843492:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.843500:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.843506:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844207:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e9b09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844219:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e9b09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844226:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e9b09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032233.844236:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787032233.844437:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844445:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844452:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844459:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032233.844470:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844479:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844491:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cdc3864100) 00010000:00010000:2.0:1787032233.844495:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032233.844499:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844506:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9afb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844518:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844525:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844532:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844537:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032233.844540:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844546:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844554:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99cdc3864500) 00010000:00010000:2.0:1787032233.844556:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032233.844565:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.844572:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9b02 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.848426:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9af4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27ad expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.848455:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e9b09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27ad expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032233.848465:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:2.0:1787032233.848468:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032233.848471:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7400, rc 0) 00000100:00100000:2.0:1787032233.848555:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:10197:x1873838835001088:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 5273us (5699us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787032233.848565:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 34 00000100:00100000:1.0:1787032233.856295:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032233.856441:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835001216 00000100:00100000:2.0:1787032233.856451:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835001216 00000100:00100000:2.0:1787032233.856504:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 35 00000100:00100000:2.0:1787032233.856514:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:10197:x1873838835001216:12345-192.168.201.48@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787032233.856868:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:10197:x1873838835001216:12345-192.168.201.48@tcp:59:lhsmtool_posix.0 Request processed in 354us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032233.856877:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 35 00000040:00080000:0.0:1787032234.497836:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787032234.695662:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032235.651751:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032235.651797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032235.651812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032235.651838:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835001600 00000100:00100000:1.0:1787032235.651845:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835001600 00000100:00100000:1.0:1787032235.651890:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835001472 00000100:00100000:1.0:1787032235.651891:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835001472 00000100:00100000:1.0:1787032235.651905:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 130 00000100:00100000:1.0:1787032235.651911:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838835001600:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032235.651986:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838835001600:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032235.651994:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 130 00000100:00100000:1.0:1787032235.652012:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 131 00000100:00100000:1.0:1787032235.652019:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835001472:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032235.652046:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835001472:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032235.652051:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 131 00000100:00080000:1.0:1787032235.652105:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032235.652447:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835001344 00000100:00100000:2.0:1787032235.652451:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835001344 00000100:00100000:2.0:1787032235.652486:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 283 00000100:00100000:2.0:1787032235.652494:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838835001344:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032235.652539:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838835001344:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 46us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032235.652544:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 283 00010000:00010000:0.0:1787032235.713567:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032236.104514:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032236.104750:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835001728 00000100:00100000:3.0:1787032236.104759:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835001728 00000100:00100000:3.0:1787032236.104814:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:3.0:1787032236.104823:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:10239:x1873838835001728:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032236.104843:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032236.104864:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27b4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.104927:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.104941:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.104952:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.104976:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.104984:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.104991:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105283:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105292:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105299:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105305:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032236.105309:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105316:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105328:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:3.0:1787032236.105331:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032236.105335:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105341:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9b1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105357:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105364:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105370:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105375:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032236.105378:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105383:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105390:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99cdcba3a700) 00010000:00010000:3.0:1787032236.105392:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032236.105395:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105400:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105441:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9b17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27b4 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105451:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:3.0:1787032236.105453:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032236.105462:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27b4 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.105471:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418200, rc 0) 00000100:00100000:3.0:1787032236.105532:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:10239:x1873838835001728:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 709us (1029us total) trans 0 rc 301/301 00000100:00100000:3.0:1787032236.105540:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:2.0:1787032236.145249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032236.145291:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835001984 00000100:00100000:2.0:1787032236.145302:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835001984 00000100:00100000:2.0:1787032236.145363:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:2.0:1787032236.145373:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:10239:x1873838835001984:12345-192.168.201.48@tcp:36:lfs.0 00010000:00010000:2.0:1787032236.145446:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032236.145477:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ad1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b279f expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.145495:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032236.145506:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032236.145824:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.145841:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.145853:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.145865:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.145872:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.145891:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032236.146982:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787032236.146997:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.147006:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.147013:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.147019:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032236.147024:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.147032:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.147046:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864500) 00010000:00010000:2.0:1787032236.147050:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032236.147054:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.147060:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9b2c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787032236.147116:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004342ec65 reply state 00000000f2ee20e9 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032236.147137:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787032236.147250:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+10:10239:x1873838835001984:12345-192.168.201.48@tcp:36:lfs.0 Request processed in 1875us (2008us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787032236.147259:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 37 00010000:00010000:3.0:1787032236.159008:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.159025:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.159032:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.159039:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032236.159044:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.159051:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.159597:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99cdc3864a00) 00010000:00010000:3.0:1787032236.159603:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032236.159609:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.159617:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9b33 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032236.237243:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032236.237344:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835002112 00000100:00100000:3.0:1787032236.237363:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835002112 00000100:00100000:3.0:1787032236.237431:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 38 00000100:00100000:3.0:1787032236.237442:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:10247:x1873838835002112:12345-192.168.201.48@tcp:101:lctl.0 00010000:00010000:3.0:1787032236.237467:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032236.237491:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9b3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27bb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.237563:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.237577:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.237588:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032236.237668:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787032236.237672:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032236.237714:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.237741:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9b3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27bb expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.237760:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27bb expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.237770:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:3.0:1787032236.237773:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787032236.237777:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419e00, rc 0) 00000100:00100000:3.0:1787032236.237849:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+10:10247:x1873838835002112:12345-192.168.201.48@tcp:101:lctl.0 Request processed in 408us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032236.237857:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 38 00000100:00100000:2.0:1787032236.301949:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032236.311761:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835002240 00000100:00100000:1.0:1787032236.311779:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835002240 00000100:00100000:1.0:1787032236.311858:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:1.0:1787032236.311869:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+10:10253:x1873838835002240:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032236.311890:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032236.312176:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27c2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313208:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313228:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313239:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313254:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313261:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313268:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313375:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031400/0xcd047797ef1e9b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313383:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031400/0xcd047797ef1e9b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313390:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031400/0xcd047797ef1e9b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032236.313422:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787032236.313425:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032236.313480:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031400/0xcd047797ef1e9b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313512:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313519:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313527:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313533:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032236.313537:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313546:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313558:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:0.0:1787032236.313562:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032236.313566:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313573:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1e9b4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313586:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313592:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313598:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313608:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032236.313624:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313631:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313640:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032236.313643:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032236.313646:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313651:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9b56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313687:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c2 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313703:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031400/0xcd047797ef1e9b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c2 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.313710:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032236.313712:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787032236.313714:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0031400, rc 0) 00000100:00100000:0.0:1787032236.313805:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+11:10253:x1873838835002240:12345-192.168.201.48@tcp:101:bash.0 Request processed in 1937us (11869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032236.313815:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:2.0:1787032236.323826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032236.324670:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835002496 00000100:00100000:1.0:1787032236.324681:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835002496 00000100:00100000:1.0:1787032236.324756:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:1.0:1787032236.324766:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+11:10253:x1873838835002496:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032236.324789:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032236.324811:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9b64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27c9 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.324958:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.324973:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.324985:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325035:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325044:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325110:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787032236.325676:0:7755:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787032236.325852:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325864:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325873:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325911:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325918:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325925:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325931:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032236.325936:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325942:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325955:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032236.325957:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032236.325969:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.325975:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9b6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032236.325990:0:7755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c2215bc reply state 000000005001a636 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032236.325999:0:7755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787032236.326036:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9b64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 14 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.326050:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 13 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.326058:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff300) 00010000:00010000:1.0:1787032236.326115:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032236.326118:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775a00, rc 0) 00000100:00100000:1.0:1787032236.326203:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+14:10253:x1873838835002496:12345-192.168.201.48@tcp:101:bash.0 Request processed in 1437us (2386us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787032236.326212:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 40 00010000:00010000:0.0:1787032236.328607:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.328647:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.328654:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.328660:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032236.328665:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.328673:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.328688:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff900) 00010000:00010000:0.0:1787032236.328700:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032236.328706:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.328713:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9b72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032236.331932:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032236.332367:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835002624 00000100:00100000:1.0:1787032236.332378:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835002624 00000100:00100000:1.0:1787032236.332428:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:1.0:1787032236.332436:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1873838835002624:12345-192.168.201.48@tcp:8:bash.0 00010000:00080000:1.0:1787032236.332573:0:6587:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:1.0:1787032236.332606:0:6587:0:(genops.c:1406:class_connect()) connect: client 5d144536-0f5d-43dc-8f25-f68546215872, cookie 0xcd047797ef1e9b87 00002000:00100000:1.0:1787032236.332700:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d144536-0f5d-43dc-8f25-f68546215872/ffff99cdc549a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787032236.332740:0:6587:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787032236.333354:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787032236.333387:0:6587:0:(import.c:65:import_set_state_nolock()) ffff99cdc549c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787032236.333570:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2353:x1873838835002624:12345-192.168.201.48@tcp:8:bash.0 Request processed in 1131us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032236.333580:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:2.0:1787032236.338437:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032236.338641:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835002752 00000100:00100000:3.0:1787032236.338774:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835002752 00000100:00100000:3.0:1787032236.338918:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:3.0:1787032236.338930:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:0:x1873838835002752:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:3.0:1787032236.338950:0:6895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032236.338973:0:6895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27d0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787032236.339000:0:6895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787032236.339019:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1787032236.339024:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032236.339034:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 7 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.339054:0:6895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 7 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.339129:0:6895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418200, rc 0) 00000100:00100000:3.0:1787032236.339197:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:0:x1873838835002752:12345-192.168.201.48@tcp:101:bash.0 Request processed in 269us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032236.339204:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:3.0:1787032236.346639:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.346922:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835002880 00000100:00100000:0.0:1787032236.346934:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835002880 00000100:00100000:0.0:1787032236.347009:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:0.0:1787032236.347020:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:10253:x1873838835002880:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032236.347040:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032236.347156:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27d7 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.347205:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 8 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.347212:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032236.347216:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032236.347219:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.347249:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 8 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.347260:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 8 pid: 6895 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032236.347271:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6584:1873838857057920:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032236.347341:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6ff00 going to sleep for 11 seconds 00000100:00080000:1.0:1787032236.349444:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787032236.350125:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6584:1873838857057920:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032236.350167:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.350241:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030000, rc 0) 00000100:00100000:0.0:1787032236.350352:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:10253:x1873838835002880:12345-192.168.201.48@tcp:101:bash.0 Request processed in 3333us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032236.350363:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:3.0:1787032236.352881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032236.354103:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835003008 00000100:00100000:1.0:1787032236.354117:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835003008 00010000:00010000:1.0:1787032236.354166:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 8 pid: 6895 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032236.354253:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 35 00000100:00100000:2.0:1787032236.354267:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835003008:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032236.354283:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032236.354308:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 8 pid: 6895 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.354324:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 8 pid: 6895 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.354349:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1e9b8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d0 expref: 8 pid: 6895 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.354366:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032236.354370:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032236.354377:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.354403:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.354443:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032236.354459:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1873838857058048:192.168.201.48@tcp:105: 00000100:00100000:2.0:1787032236.354540:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded1496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032236.356291:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1873838857058048:192.168.201.48@tcp:105: 00010000:00010000:2.0:1787032236.356324:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032236.356376:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835003008:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 2113us (3509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032236.356388:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 35 00000100:00100000:3.0:1787032236.359535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.359885:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835003264 00000100:00100000:0.0:1787032236.359895:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835003264 00000100:00100000:0.0:1787032236.359976:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:0.0:1787032236.359987:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+13:10253:x1873838835003264:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:0.0:1787032236.360954:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:10253:x1873838835003264:12345-192.168.201.48@tcp:35:bash.0 Request processed in 961us (1423us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787032236.360966:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:0.0:1787032236.445289:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032236.445731:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835003520 00000100:00100000:2.0:1787032236.445742:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835003520 00000100:00100000:2.0:1787032236.445912:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:2.0:1787032236.445931:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:10263:x1873838835003520:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032236.445956:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032236.445978:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9b9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27de expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032236.446144:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787032236.446272:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9b9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27de expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.446308:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:2.0:1787032236.446311:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032236.446317:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9b9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27de expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.446335:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032236.447302:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:10263:x1873838835003520:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1367us (2019us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787032236.447312:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:3.0:1787032236.451433:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.451499:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835003776 00000100:00100000:0.0:1787032236.451512:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835003776 00000100:00100000:0.0:1787032236.451569:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:0.0:1787032236.451579:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:10263:x1873838835003776:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:0.0:1787032236.451874:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+16:10263:x1873838835003776:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 295us (453us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787032236.451881:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:3.0:1787032236.573135:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032236.573312:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835003904 00000100:00100000:1.0:1787032236.573324:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835003904 00000100:00100000:1.0:1787032236.573404:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:1.0:1787032236.573417:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+16:10269:x1873838835003904:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032236.573586:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032236.573614:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27e5 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.573695:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9bb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.573709:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.573722:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032236.578571:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787032236.578584:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032236.578636:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.578685:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27e5 expref: 18 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.578713:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27e5 expref: 17 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.578724:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032236.578728:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787032236.578733:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775200, rc 0) 00000100:00100000:1.0:1787032236.578841:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+17:10269:x1873838835003904:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 5426us (5717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032236.578850:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:2.0:1787032236.583254:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.583368:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835004160 00000100:00100000:0.0:1787032236.583379:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835004160 00000100:00100000:0.0:1787032236.583441:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 43 00000100:00100000:0.0:1787032236.583449:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+17:10269:x1873838835004160:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032236.583472:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032236.583512:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9bb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27ec expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.583618:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e9bbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.583633:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e9bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.583657:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e9bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032236.583669:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787032236.583800:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1e9bb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27ec expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.583819:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e9bbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27ec expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.583828:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff300) 00010000:00010000:0.0:1787032236.583831:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032236.583834:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030e00, rc 0) 00000100:00100000:0.0:1787032236.583901:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+19:10269:x1873838835004160:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 452us (659us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787032236.583910:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 43 00000100:00100000:3.0:1787032236.589208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.589795:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835004416 00000100:00100000:0.0:1787032236.589808:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835004416 00000100:00100000:0.0:1787032236.589880:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:0.0:1787032236.589892:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+19:10269:x1873838835004416:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032236.589917:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032236.589938:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9bcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27f3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.590082:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9bd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.590114:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.590127:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032236.590144:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787032236.590282:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1e9bcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27f3 expref: 22 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.590303:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27f3 expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.590312:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff300) 00010000:00010000:0.0:1787032236.590315:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787032236.590319:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537800, rc 0) 00000100:00100000:0.0:1787032236.590394:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+21:10269:x1873838835004416:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 504us (1198us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787032236.590403:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:3.0:1787032236.595895:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.595964:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835004544 00000100:00100000:0.0:1787032236.595979:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835004544 00000100:00100000:0.0:1787032236.596030:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:0.0:1787032236.596037:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+21:2356:x1873838835004544:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032236.596051:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032236.596114:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1e9bbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27ec expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.596153:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff300) 00010000:00010000:0.0:1787032236.596158:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032236.596216:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+20:2356:x1873838835004544:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 177us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032236.596224:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:2.0:1787032236.599263:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032236.599339:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835004672 00000100:00100000:3.0:1787032236.599359:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835004672 00000100:00100000:3.0:1787032236.599421:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:3.0:1787032236.599433:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835004672:12345-192.168.201.48@tcp:1:lfs.0 00010000:00010000:3.0:1787032236.599491:0:6895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.599514:0:6895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.599524:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032236.599528:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787032236.599534:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.599573:0:6895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.599585:0:6895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 7 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032236.599597:0:6895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6895:1873838857058176:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032236.599701:0:6895:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032236.601779:0:6895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6895:1873838857058176:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032236.601823:0:6895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032236.603224:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032236.603325:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835004800 00000100:00100000:3.0:1787032236.603335:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835004800 00002000:00100000:3.0:1787032236.603443:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff99cdfb31ca80 x1873838835004800/t0(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:97/0 lens 504/0 e 0 to 0 dl 1787032247 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787032236.603451:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdfb31ca80 with x1873838835004800 ext(0->12) 00010000:00010000:3.0:1787032236.603458:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 8 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.603470:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 8 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787032236.603475:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99cdfb31ca80 00000100:00100000:3.0:1787032236.603511:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:3.0:1787032236.603519:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835004800:12345-192.168.201.48@tcp:4:lfs.0 00000001:00100000:0.0:1787032236.652929:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000100:00100000:1.0:1787032236.653657:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835004800:12345-192.168.201.48@tcp:4:lfs.0 Request processed in 50132us (50434us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787032236.653674:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00002000:00100000:1.0:1787032236.653689:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff99cdfb31ca80 x1873838835004800/t4294967299(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:97/0 lens 504/448 e 0 to 0 dl 1787032247 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032236.653700:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdfb31ca80 with x1873838835004800 ext(0->12) 00010000:00010000:1.0:1787032236.653711:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 9 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.653744:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 9 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787032236.653753:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99cdfb31ca80 00000100:00100000:3.0:1787032236.659888:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.660098:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835004928 00000100:00100000:0.0:1787032236.660109:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835004928 00010000:00010000:0.0:1787032236.660153:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 9 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032236.660253:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:0.0:1787032236.660263:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:2355:x1873838835004928:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032236.660280:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787032236.660302:0:5784:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787032236.660305:0:5784:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787032235 00002000:00010000:0.0:1787032236.660307:0:5784:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787032236 00002000:00010000:0.0:1787032236.660310:0:5784:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787032235 00010000:00010000:0.0:1787032236.660316:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 9 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.660329:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 9 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.660355:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ad395f9/0xcd047797ef1e9b95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27d7 expref: 9 pid: 6584 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.660387:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032236.660392:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032236.660399:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.660409:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.660447:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032236.660528:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:2355:x1873838835004928:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 266us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032236.660536:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 36 00010000:00010000:3.0:1787032236.660597:0:6895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.660608:0:6895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.660634:0:6895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.660642:0:6895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.660658:0:6895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.660666:0:6895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032236.660670:0:6895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.660679:0:6895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.660692:0:6895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.660701:0:6895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1e9be2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032236.660751:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835004672:12345-192.168.201.48@tcp:1:lfs.0 Request processed in 61321us (61497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032236.660759:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:3.0:1787032236.664515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032236.664646:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835005184 00000100:00100000:1.0:1787032236.664657:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835005184 00000100:00100000:1.0:1787032236.664721:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:1.0:1787032236.664732:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+20:10269:x1873838835005184:12345-192.168.201.48@tcp:35:lfs.0 00000004:00010000:1.0:1787032236.664802:0:5801:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27f3 expref: 20 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787032236.665146:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787032236.665206:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787032236.665846:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787032236.665914:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.665948:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 24 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.665958:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.665995:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 24 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.666012:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 24 pid: 7755 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032236.666036:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff62c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1873838857058304:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032236.666175:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded1c7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787032236.668670:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff62c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1873838857058304:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032236.668706:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032236.669378:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.669445:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835005312 00000100:00100000:0.0:1787032236.669455:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835005312 00010000:00010000:0.0:1787032236.669513:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 25 pid: 7755 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032236.669559:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:0.0:1787032236.669567:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+25:2355:x1873838835005312:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032236.669582:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032236.669588:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 25 pid: 7755 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.669618:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 25 pid: 7755 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.669642:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c9 expref: 25 pid: 7755 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.669660:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff300) 00010000:00010000:0.0:1787032236.669665:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.669676:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.669684:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.669717:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032236.669773:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+24:2355:x1873838835005312:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 205us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032236.669780:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 37 00010000:00010000:1.0:1787032236.670345:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.670356:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787032236.670522:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787032236.670722:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787032236.670831:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff62ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857058432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787032236.672380:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032236.672454:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded1c7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032236.672685:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857058432 00000100:00100000:0.0:1787032236.672696:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857058432 00000100:00100000:0.0:1787032236.672773:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032236.672783:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857058432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787032236.672898:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857058432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032236.672905:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787032236.674387:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787032236.674455:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff62ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857058432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787032236.675885:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787032236.675982:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff62ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857058560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787032236.676051:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032236.677603:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded1c7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787032236.682377:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857058560 00000100:00100000:0.0:1787032236.682394:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857058560 00000100:00100000:1.0:1787032236.693087:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787032236.693103:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857058560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787032236.693396:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5801:x1873838857058560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 295us (17343us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787032236.693404:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032236.693747:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff62ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857058560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787032236.693836:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787032236.693891:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.693914:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.693922:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.693928:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032236.693933:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.693941:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.693957:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff300) 00010000:00010000:3.0:1787032236.693960:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787032236.693964:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032236.693970:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9be9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787032236.694227:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787032236.694462:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787032236.694474:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391540405263ns, next at 392540403100ns, rc = 0 00000001:00080000:3.0:1787032236.694692:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787032236.694739:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff300) 00010000:00010000:3.0:1787032236.694742:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787032236.694750:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9bd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27f3 expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032236.694959:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+27:10269:x1873838835005184:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 30226us (30460us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787032236.694968:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00000020:00080000:3.0:1787032236.694972:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787032236.703828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032236.704114:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835005440 00000100:00100000:0.0:1787032236.704126:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835005440 00000100:00100000:0.0:1787032236.704198:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:0.0:1787032236.704208:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+27:10269:x1873838835005440:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032236.704235:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032236.704261:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1e9bf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b27fa expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.704331:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1e9bf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27fa expref: 28 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.704349:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1e9bf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27fa expref: 28 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032236.704368:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032236.704372:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032236.704376:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536800, rc 0) 00000100:00100000:0.0:1787032236.704440:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+28:10269:x1873838835005440:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 233us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032236.704448:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:2.0:1787032236.720687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032236.720773:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835005696 00000100:00100000:3.0:1787032236.720784:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835005696 00000100:00100000:3.0:1787032236.720855:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:3.0:1787032236.720865:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+28:10269:x1873838835005696:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032236.721186:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+29:10269:x1873838835005696:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 321us (508us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787032236.721195:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00010000:00010000:1.0:1787032236.737450:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032236.899683:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032236.899866:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835005952 00000100:00100000:1.0:1787032236.899876:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835005952 00000100:00100000:1.0:1787032236.899944:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:1.0:1787032236.899953:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+29:10279:x1873838835005952:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032236.899979:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032236.900001:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2801 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032236.900181:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787032236.900305:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9bf7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2801 expref: 31 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.900320:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:1.0:1787032236.900322:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787032236.900327:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2801 expref: 31 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.900339:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032236.900391:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+30:10279:x1873838835005952:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 439us (718us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787032236.900397:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:0.0:1787032236.908220:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032236.908335:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835006080 00000100:00100000:2.0:1787032236.908347:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835006080 00000100:00100000:2.0:1787032236.908414:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:2.0:1787032236.908425:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+30:10279:x1873838835006080:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:2.0:1787032236.908523:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908540:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908566:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908583:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908591:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908598:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908715:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908724:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908731:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787032236.908775:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908789:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908795:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908803:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908820:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032236.908825:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908832:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908845:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:2.0:1787032236.908849:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032236.908854:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908861:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908877:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908883:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908890:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908895:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032236.908898:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908904:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908924:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdc3864500) 00010000:00010000:2.0:1787032236.908927:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032236.908930:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908936:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908951:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908958:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.908964:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.909328:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032236.909332:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.909339:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.909349:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:2.0:1787032236.909351:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032236.909355:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.909360:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1e9c13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032236.909461:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+30:10279:x1873838835006080:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 1035us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032236.909471:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:2.0:1787032236.915279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032236.915446:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835006336 00000100:00100000:3.0:1787032236.915458:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835006336 00000100:00100000:3.0:1787032236.915533:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:3.0:1787032236.915544:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+30:10279:x1873838835006336:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032236.915815:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+31:10279:x1873838835006336:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 271us (545us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787032236.915823:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:3.0:1787032236.982651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032236.982762:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835006592 00000100:00100000:1.0:1787032236.982773:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835006592 00000100:00100000:1.0:1787032236.982853:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:1.0:1787032236.982864:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+31:10282:x1873838835006592:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032236.982893:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032236.982917:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9c1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2808 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983024:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983041:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983060:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983124:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983132:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983139:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983280:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983289:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983295:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032236.983306:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787032236.983413:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983421:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983435:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983440:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032236.983445:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983452:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983464:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032236.983467:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032236.983472:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983479:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9c21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983492:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983498:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983503:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983509:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032236.983512:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983529:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983537:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff700) 00010000:00010000:1.0:1787032236.983539:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032236.983542:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983547:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983588:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9c1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 34 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983600:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 33 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032236.983607:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:1.0:1787032236.983609:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032236.983611:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775a00, rc 0) 00000100:00100000:1.0:1787032236.983668:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+33:10282:x1873838835006592:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 806us (1043us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787032236.983675:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:0.0:1787032236.988403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032236.988509:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835006720 00000100:00100000:2.0:1787032236.988521:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835006720 00000100:00100000:2.0:1787032236.988587:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:2.0:1787032236.988598:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+33:10282:x1873838835006720:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:2.0:1787032236.988670:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988690:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988704:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988735:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988742:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988749:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988756:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032236.988760:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988786:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988800:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:2.0:1787032236.988815:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032236.988820:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032236.988825:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032236.988901:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+33:10282:x1873838835006720:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 304us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032236.988909:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:2.0:1787032236.995905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032236.996738:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835006976 00000100:00100000:3.0:1787032236.996750:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835006976 00000100:00100000:3.0:1787032236.996826:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:3.0:1787032236.996838:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+33:10282:x1873838835006976:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032236.997180:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+34:10282:x1873838835006976:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 343us (1284us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787032236.997188:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:3.0:1787032237.219418:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032237.219533:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835007232 00000100:00100000:1.0:1787032237.219544:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835007232 00000100:00100000:1.0:1787032237.219620:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 50 00000100:00100000:1.0:1787032237.219630:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+34:10313:x1873838835007232:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:1.0:1787032237.219677:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032237.219698:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9c44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b280f expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.219805:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.219817:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.219826:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032237.219834:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787032237.219945:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9c44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b280f expref: 37 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.219959:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b280f expref: 36 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.219968:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:1.0:1787032237.219971:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032237.219974:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775c00, rc 0) 00000100:00100000:1.0:1787032237.220040:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+36:10313:x1873838835007232:12345-192.168.201.48@tcp:101:cat.0 Request processed in 411us (633us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787032237.220057:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 50 00000100:00080000:2.0:1787032237.220694:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032237.223555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032237.223628:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835007488 00000100:00100000:3.0:1787032237.223646:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835007488 00000100:00100000:3.0:1787032237.223699:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:3.0:1787032237.223708:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+36:10313:x1873838835007488:12345-192.168.201.48@tcp:35:cat.0 00000100:00100000:3.0:1787032237.223997:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+37:10313:x1873838835007488:12345-192.168.201.48@tcp:35:cat.0 Request processed in 289us (450us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787032237.224006:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:3.0:1787032237.225167:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032237.225277:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835007616 00000100:00100000:2.0:1787032237.225285:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835007616 00000100:00100000:2.0:1787032237.225345:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:2.0:1787032237.225354:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+37:2357:x1873838835007616:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032237.225370:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032237.225400:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9c4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b280f expref: 37 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.225420:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:2.0:1787032237.225426:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032237.225479:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+36:2357:x1873838835007616:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 125us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032237.225513:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:1.0:1787032237.269597:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032237.269695:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835007872 00000100:00100000:2.0:1787032237.269706:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835007872 00000100:00100000:2.0:1787032237.269766:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00100000:2.0:1787032237.269777:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+36:10319:x1873838835007872:12345-192.168.201.48@tcp:101:dd.0 00010000:00010000:2.0:1787032237.269803:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032237.269807:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787032237.269837:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9bb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27e5 expref: 36 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.269856:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:2.0:1787032237.269862:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032237.269878:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2816 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.269985:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.269999:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 36 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.270007:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.270053:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 36 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.270119:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 36 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032237.270151:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857058688:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032237.270250:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc893a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787032237.272826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032237.273010:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835008000 00000100:00100000:0.0:1787032237.273020:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835008000 00010000:00010000:0.0:1787032237.273117:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 37 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032237.273186:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 38 00000100:00100000:0.0:1787032237.273196:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+37:2354:x1873838835008000:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032237.273212:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032237.273218:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 37 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.273230:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 37 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.273254:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032237.273258:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.273267:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.273274:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.273295:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032237.273355:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+37:2354:x1873838835008000:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 160us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032237.273363:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 38 00010000:00010000:2.0:1787032237.275567:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2808 expref: 36 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032237.275586:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857058688:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032237.275606:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.275613:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.275617:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032237.275636:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787032237.275796:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1e9c59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.275807:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 36 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.275814:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:2.0:1787032237.275816:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787032237.275819:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6400, rc 0) 00000100:00100000:2.0:1787032237.275875:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+36:10319:x1873838835007872:12345-192.168.201.48@tcp:101:dd.0 Request processed in 6100us (6291us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787032237.275898:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00100000:1.0:1787032237.280777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032237.280855:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835008256 00000100:00100000:3.0:1787032237.280866:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835008256 00000100:00100000:3.0:1787032237.280931:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00100000:3.0:1787032237.280941:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+36:10319:x1873838835008256:12345-192.168.201.48@tcp:36:dd.0 00010000:00010000:3.0:1787032237.281280:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032237.281297:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032237.281307:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787032237.281359:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787032237.281386:0:7755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042afe25c reply state 00000000df8c6fc2 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032237.281405:0:7755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787032237.281763:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+39:10319:x1873838835008256:12345-192.168.201.48@tcp:36:dd.0 Request processed in 822us (996us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787032237.281771:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 52 00000020:00080000:3.0:1787032237.281776:0:7755:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787032237.283436:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.283452:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.283460:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.283467:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032237.283473:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.283481:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.283511:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:1.0:1787032237.283515:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032237.283520:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.283527:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9c6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032237.568024:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032237.568764:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835008384 00000100:00100000:0.0:1787032237.568775:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835008384 00000100:00100000:0.0:1787032237.568897:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:0.0:1787032237.568908:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+38:10333:x1873838835008384:12345-192.168.201.48@tcp:101:stat.0 00010000:00010000:0.0:1787032237.568968:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032237.568992:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9c75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b281d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569144:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569160:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569171:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569186:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569192:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569199:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569297:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569308:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 39 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569316:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569351:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 39 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.569372:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 39 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032237.569388:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857058816:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032237.570626:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032237.573683:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032237.574062:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835008640 00000100:00100000:1.0:1787032237.574103:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835008640 00000100:00100000:1.0:1787032237.574166:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:1.0:1787032237.574177:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+40:5569:x1873838835008640:12345-192.168.201.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787032237.574857:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+41:5569:x1873838835008640:12345-192.168.201.48@tcp:35:ldlm_bl.0 Request processed in 677us (1180us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787032237.574884:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:0.0:1787032237.575273:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857058816:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032237.575306:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032237.579242:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032237.579550:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835008768 00000100:00100000:2.0:1787032237.579561:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835008768 00010000:00010000:2.0:1787032237.579605:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 41 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032237.579772:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:2.0:1787032237.579784:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+41:2355:x1873838835008768:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032237.579802:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032237.579811:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 41 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.579828:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 41 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.579856:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9c60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2816 expref: 41 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.579873:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:2.0:1787032237.579878:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.579888:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.579897:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.579963:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032237.580186:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580196:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032237.580240:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787032237.580244:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032237.580284:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580297:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580307:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580313:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580319:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580325:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032237.580329:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580336:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580356:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032237.580359:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032237.580362:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580367:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580379:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580385:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580390:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580394:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032237.580397:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580403:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580410:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdc4f0a200) 00010000:00010000:1.0:1787032237.580412:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032237.580415:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580421:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580471:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9c75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b281d expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580500:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b281d expref: 40 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.580507:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:1.0:1787032237.580509:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032237.580512:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537c00, rc 0) 00000100:00100000:2.0:1787032237.580597:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+40:2355:x1873838835008768:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 814us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032237.580607:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:1.0:1787032237.580656:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+39:10333:x1873838835008384:12345-192.168.201.48@tcp:101:stat.0 Request processed in 11749us (12655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032237.580663:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:1.0:1787032237.666528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032237.666696:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835009024 00000100:00100000:0.0:1787032237.666707:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835009024 00000100:00100000:0.0:1787032237.666788:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 54 00000100:00100000:0.0:1787032237.666800:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+39:10339:x1873838835009024:12345-192.168.201.48@tcp:36:truncate.0 00010000:00010000:0.0:1787032237.666874:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032237.666903:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9c8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b281d expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.666928:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032237.666933:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032237.667235:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.667250:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.667259:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787032237.667348:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787032237.667380:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f2a95184 reply state 00000000c755e649 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032237.667391:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787032237.667535:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+41:10339:x1873838835009024:12345-192.168.201.48@tcp:36:truncate.0 Request processed in 736us (1019us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787032237.667543:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 54 00000020:00080000:0.0:1787032237.667547:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787032237.672922:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.672943:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.672951:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.672958:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032237.672964:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.672972:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.672990:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032237.672994:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032237.672998:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.673004:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9c91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032237.762085:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032237.826242:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857059328:0@lo:400:kworker.0 00000100:00100000:0.0:1787032237.826316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032237.826380:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787032237.826387:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857059200:0@lo:400:kworker.0 00000100:00100000:0.0:1787032237.826414:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032237.826447:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857059200 00000100:00100000:0.0:1787032237.826455:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857059200 00000100:00100000:0.0:1787032237.826509:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787032237.826518:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857059200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032237.826575:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857059200:12345-0@lo:400:kworker.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032237.826582:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1787032237.826602:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032237.826642:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857059200:0@lo:400:kworker.0 00000100:00100000:1.0:1787032237.826805:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857058944:0@lo:400:kworker.0 00000100:00100000:1.0:1787032237.826844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032237.826879:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857059456:0@lo:400:kworker.0 00000100:00100000:1.0:1787032237.826903:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032237.826920:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787032237.826927:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857059072:0@lo:400:kworker.0 00000100:00100000:1.0:1787032237.826948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032237.826967:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857059584:0@lo:400:kworker.0 00000100:00100000:1.0:1787032237.826988:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032237.827014:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857059456 00000100:00100000:1.0:1787032237.827018:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857059456 00000100:00100000:1.0:1787032237.827058:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857059072 00000100:00100000:1.0:1787032237.827096:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857059072 00000100:00100000:1.0:1787032237.827116:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787032237.827122:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857059456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032237.827178:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857059456:12345-0@lo:400:kworker.0 Request processed in 55us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032237.827184:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787032237.827198:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787032237.827205:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857059072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032237.827232:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857059072:12345-0@lo:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032237.827239:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1787032237.827252:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032237.827272:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857059072:0@lo:400:kworker.0 00000100:00100000:1.0:1787032237.827283:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857059456:0@lo:400:kworker.0 00000100:00100000:0.0:1787032237.827568:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857058944 00000100:00100000:0.0:1787032237.827572:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857058944 00000100:00100000:0.0:1787032237.827609:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787032237.827616:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857058944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032237.827667:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857058944:12345-0@lo:400:kworker.0 Request processed in 51us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032237.827673:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787032237.827699:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857059328 00000100:00100000:0.0:1787032237.827703:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857059328 00000100:00100000:0.0:1787032237.827725:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857059584 00000100:00100000:0.0:1787032237.827728:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857059584 00000100:00100000:0.0:1787032237.827763:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787032237.827781:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857059328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032237.827969:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787032237.827980:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857059584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032237.828016:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857059584:12345-0@lo:400:kworker.0 Request processed in 40us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032237.828023:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787032237.828104:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857059584:0@lo:400:kworker.0 00000100:00100000:3.0:1787032237.828114:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857058944:0@lo:400:kworker.0 00000100:00080000:3.0:1787032237.828154:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032237.828252:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857059328:12345-0@lo:400:kworker.0 Request processed in 483us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032237.828258:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787032237.828330:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857059328:0@lo:400:kworker.0 00000100:00100000:2.0:1787032237.873587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032237.873846:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835009152 00000100:00100000:1.0:1787032237.873858:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835009152 00000100:00100000:1.0:1787032237.873918:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 55 00000100:00100000:1.0:1787032237.873929:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+40:10353:x1873838835009152:12345-192.168.201.48@tcp:101:stat.0 00010000:00010000:1.0:1787032237.873953:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032237.873974:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9c98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2824 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874056:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874101:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874127:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874144:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874152:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874158:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874484:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874494:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874502:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032237.874537:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787032237.874542:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032237.874565:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874576:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874584:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874601:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874608:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874614:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032237.874970:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874979:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.874992:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032237.874995:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032237.875000:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875015:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9c9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875031:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875045:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875051:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875056:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032237.875182:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875191:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875201:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff700) 00010000:00010000:1.0:1787032237.875204:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032237.875208:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875214:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9ca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875252:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9c98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 42 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875266:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 41 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.875272:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:1.0:1787032237.875274:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032237.875277:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032237.875350:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+41:10353:x1873838835009152:12345-192.168.201.48@tcp:101:stat.0 Request processed in 1423us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032237.875358:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 55 00000001:00080000:1.0:1787032237.920908:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000020:00080000:1.0:1787032237.921441:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cded1c7b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787032237.921449:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdfadf7100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cded1c7e40 00000020:00080000:1.0:1787032237.921460:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdfadf7800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdef026000 00000020:00080000:3.0:1787032237.921566:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787032237.921711:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:1.0:1787032237.933182:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787032237.933373:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857059712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787032237.933451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032237.933546:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857059712 00000100:00100000:1.0:1787032237.933554:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857059712 00000100:00100000:1.0:1787032237.933601:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787032237.933611:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1873838857059712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787032237.933642:0:6895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787032237.933676:0:6895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a83f2ab, atime: 0x6a83f2ac, ctime: 0x6a83f2ab, blocks: 0x1 00010000:00010000:1.0:1787032237.933685:0:6895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.933702:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1787032237.933707:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032237.933714:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.933733:0:6895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.933744:0:6895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.933752:0:6895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.933798:0:6895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787032237.939368:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857059712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5747us (5905us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787032237.939383:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1787032237.939416:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cde4872a00/2, rc 0, transno 4294967301 00010000:00010000:1.0:1787032237.939417:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032237.939425:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032237.939425:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857059712:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787032237.939437:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032237.939442:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.939453:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.939884:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.939895:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070ba1b10/0xcd047797ef1e9cb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032237.939915:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032237.939917:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032237.939919:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032237.947879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032237.947961:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835009408 00000100:00100000:1.0:1787032237.947970:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835009408 00000100:00100000:1.0:1787032237.948047:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 56 00000100:00100000:1.0:1787032237.948058:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+11:10363:x1873838835009408:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032237.948123:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032237.948230:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9cbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b282b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032237.948484:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787032237.948654:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9cbb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b282b expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.948670:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:2.0:1787032237.948673:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032237.948679:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9cbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b282b expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032237.948692:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774200, rc 0) 00000100:00100000:2.0:1787032237.948749:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+12:10363:x1873838835009408:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 693us (877us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787032237.948756:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 56 00000100:00100000:3.0:1787032237.951830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032237.951938:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835009664 00000100:00100000:1.0:1787032237.951949:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835009664 00000100:00100000:1.0:1787032237.952024:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:1.0:1787032237.952043:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+12:10363:x1873838835009664:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:1.0:1787032237.952536:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+13:10363:x1873838835009664:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 501us (714us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787032237.952545:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:0.0:1787032238.014247:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032238.014448:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835009920 00000100:00100000:2.0:1787032238.014461:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835009920 00000100:00100000:2.0:1787032238.014588:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 57 00000100:00100000:2.0:1787032238.014599:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+13:10369:x1873838835009920:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:2.0:1787032238.014639:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032238.014679:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9cc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2832 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.014809:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.014824:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 14 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.014833:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.014866:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 14 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.014881:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 14 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032238.014895:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857059840:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032238.014990:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc893af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032238.018360:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032238.018512:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835010048 00000100:00100000:0.0:1787032238.018522:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835010048 00010000:00010000:0.0:1787032238.018562:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 15 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032238.018601:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:0.0:1787032238.018610:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:2355:x1873838835010048:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032238.018632:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032238.018640:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 15 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.018653:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 15 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.018674:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032238.018679:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.018688:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.018709:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.018727:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032238.018962:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:2355:x1873838835010048:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 351us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032238.018969:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 40 00010000:00010000:2.0:1787032238.019121:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9cad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2824 expref: 14 pid: 7755 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032238.019139:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857059840:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032238.019159:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.019168:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.019187:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032238.019205:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787032238.019358:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9cc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.019373:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.019380:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:2.0:1787032238.019382:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787032238.019385:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7c00, rc 0) 00000100:00100000:2.0:1787032238.019412:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:10369:x1873838835009920:12345-192.168.201.48@tcp:101:bash.0 Request processed in 4816us (5176us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787032238.019419:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 57 00000100:00100000:3.0:1787032238.023119:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032238.023221:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835010304 00000100:00100000:2.0:1787032238.023231:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835010304 00000100:00100000:2.0:1787032238.023291:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 58 00000100:00100000:2.0:1787032238.023301:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+14:10369:x1873838835010304:12345-192.168.201.48@tcp:36:bash.0 00010000:00010000:2.0:1787032238.023650:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.023668:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.023680:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787032238.023754:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787032238.023779:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000733c905c reply state 000000006723bd10 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032238.023788:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787032238.023878:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+17:10369:x1873838835010304:12345-192.168.201.48@tcp:36:bash.0 Request processed in 577us (815us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787032238.023886:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 58 00000020:00080000:2.0:1787032238.023890:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787032238.026463:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.026492:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.026513:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.026519:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032238.026524:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.026531:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.026550:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:3.0:1787032238.026553:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032238.026558:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.026564:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9cde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032238.031063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.031318:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835010432 00000100:00100000:1.0:1787032238.031331:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835010432 00000100:00100000:1.0:1787032238.031407:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 59 00000100:00100000:1.0:1787032238.031417:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+16:10369:x1873838835010432:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032238.031440:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032238.031460:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9ce5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2839 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.031552:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.031568:0:7755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.031576:0:7755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.031610:0:7755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.031644:0:7755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 17 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032238.031659:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857059968:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032238.031737:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded1c7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032238.034922:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.035044:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857059968:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032238.035105:0:7755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032238.035222:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835010560 00000100:00100000:0.0:1787032238.035228:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835010560 00010000:00010000:0.0:1787032238.035263:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 18 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032238.035304:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:0.0:1787032238.035313:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+18:2354:x1873838835010560:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032238.035329:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032238.035336:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 18 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.035348:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 18 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.035370:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9cd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2832 expref: 18 pid: 5798 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.035386:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032238.035391:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.035418:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.035426:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.035454:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032238.035626:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+17:2354:x1873838835010560:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 312us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032238.035634:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 41 00010000:00010000:3.0:1787032238.036725:0:7755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.036738:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032238.036789:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787032238.036805:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032238.036834:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.036868:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9ce5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2839 expref: 17 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.036886:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2839 expref: 16 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.036894:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:3.0:1787032238.036897:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032238.036900:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775a00, rc 0) 00000100:00100000:3.0:1787032238.036960:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+16:10369:x1873838835010432:12345-192.168.201.48@tcp:101:bash.0 Request processed in 5544us (5908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032238.036968:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 59 00000100:00100000:1.0:1787032238.039901:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.039985:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835010816 00000100:00100000:3.0:1787032238.039995:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835010816 00000100:00100000:3.0:1787032238.040095:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:3.0:1787032238.040106:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+16:10369:x1873838835010816:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:3.0:1787032238.040433:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+17:10369:x1873838835010816:12345-192.168.201.48@tcp:35:bash.0 Request processed in 327us (540us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787032238.040442:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:0.0:1787032238.100218:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032238.100298:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835011072 00000100:00100000:2.0:1787032238.100307:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835011072 00000100:00100000:2.0:1787032238.100357:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:2.0:1787032238.100363:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+17:10379:x1873838835011072:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032238.100385:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032238.100403:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2840 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032238.100636:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787032238.100765:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9cf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2840 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.100780:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:2.0:1787032238.100783:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032238.100788:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2840 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.100803:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7600, rc 0) 00000100:00100000:2.0:1787032238.100935:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+18:10379:x1873838835011072:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 571us (724us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787032238.100943:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:2.0:1787032238.106245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.106362:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835011200 00000100:00100000:1.0:1787032238.106373:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835011200 00000100:00100000:1.0:1787032238.106484:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00100000:1.0:1787032238.106495:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+18:10379:x1873838835011200:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:1.0:1787032238.106576:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.106594:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.106606:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.106634:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.106643:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.106650:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107053:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107064:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107097:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032238.107140:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107152:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107159:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107166:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107173:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032238.107177:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107185:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107197:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032238.107200:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032238.107205:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107219:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107232:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107238:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107244:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107248:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032238.107252:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107258:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107265:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff500) 00010000:00010000:1.0:1787032238.107268:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032238.107270:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107276:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107288:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107294:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107304:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107310:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032238.107313:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107319:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107326:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:1.0:1787032238.107329:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032238.107331:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.107338:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9d0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032238.107418:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+18:10379:x1873838835011200:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 923us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032238.107427:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00100000:1.0:1787032238.109847:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.110062:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835011456 00000100:00100000:3.0:1787032238.110096:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835011456 00000100:00100000:3.0:1787032238.110158:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:3.0:1787032238.110168:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+18:10379:x1873838835011456:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032238.110642:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+19:10379:x1873838835011456:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 473us (804us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787032238.110659:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:0.0:1787032238.157604:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032238.157990:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835011712 00000100:00100000:2.0:1787032238.158001:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835011712 00000100:00100000:3.0:1787032238.158236:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 62 00000100:00100000:3.0:1787032238.158250:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+19:10382:x1873838835011712:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032238.158293:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032238.158320:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1e9d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2847 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158410:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158425:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158439:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158454:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158460:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158477:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158867:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158877:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.158895:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032238.158905:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787032238.159000:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159033:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159041:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159047:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032238.159052:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159060:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159099:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032238.159103:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032238.159108:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159115:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9d1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159128:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159134:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159148:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159154:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032238.159157:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159163:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159170:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdcba3a100) 00010000:00010000:3.0:1787032238.159173:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032238.159176:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159182:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159224:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1e9d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2847 expref: 22 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159237:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2847 expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.159244:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:3.0:1787032238.159246:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032238.159248:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418200, rc 0) 00000100:00100000:3.0:1787032238.159325:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+21:10382:x1873838835011712:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1079us (1731us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787032238.159343:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 62 00000100:00100000:1.0:1787032238.164641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.164687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032238.164835:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835011968 00000100:00100000:0.0:1787032238.164846:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835011968 00000100:00100000:0.0:1787032238.164918:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:0.0:1787032238.164928:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+21:2354:x1873838835011968:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032238.164945:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032238.164974:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1e9d2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2847 expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.164993:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032238.164998:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032238.165309:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+20:2354:x1873838835011968:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 380us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032238.165318:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:3.0:1787032238.165398:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835011840 00000100:00100000:3.0:1787032238.165403:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835011840 00000100:00100000:3.0:1787032238.165446:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:3.0:1787032238.165453:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+20:10382:x1873838835011840:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:3.0:1787032238.165532:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165546:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165557:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165583:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165590:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165597:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165602:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032238.165606:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165624:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165633:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:3.0:1787032238.165646:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787032238.165650:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.165656:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032238.165699:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+20:10382:x1873838835011840:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 246us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032238.165706:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:1.0:1787032238.175407:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.175497:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835012224 00000100:00100000:3.0:1787032238.175507:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835012224 00000100:00100000:3.0:1787032238.175555:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:3.0:1787032238.175564:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:10382:x1873838835012224:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032238.175805:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+21:10382:x1873838835012224:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 241us (413us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787032238.175814:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:2.0:1787032238.314334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.314411:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835012480 00000100:00100000:3.0:1787032238.314421:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835012480 00000100:00100000:3.0:1787032238.314476:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 64 00000100:00100000:3.0:1787032238.314486:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+21:10400:x1873838835012480:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:3.0:1787032238.314510:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032238.314533:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b284e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.314629:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1e9d47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.314644:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1e9d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.314670:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1e9d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032238.314682:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787032238.314798:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b284e expref: 24 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.314818:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1e9d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b284e expref: 23 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.314827:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:3.0:1787032238.314830:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787032238.314834:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418800, rc 0) 00000100:00100000:3.0:1787032238.314991:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+23:10400:x1873838835012480:12345-192.168.201.48@tcp:101:cat.0 Request processed in 505us (666us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787032238.314998:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 64 00000100:00100000:1.0:1787032238.339629:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032238.339661:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857060096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032238.339743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032238.339887:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857060096 00000100:00100000:2.0:1787032238.339896:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857060096 00000100:00100000:2.0:1787032238.339952:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787032238.339962:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857060096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032238.339998:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032238.340093:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857060096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032238.340102:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787032238.340156:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857060096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032238.340158:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787032238.340173:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857060224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032238.340222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032238.340356:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857060224 00000100:00100000:1.0:1787032238.340367:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857060224 00000100:00100000:1.0:1787032238.340414:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787032238.340420:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1873838857060224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032238.340439:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032238.340474:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1873838857060224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032238.340480:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787032238.340607:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787032238.340637:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857060224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032238.374298:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.374406:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835012608 00000100:00100000:3.0:1787032238.374418:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835012608 00000100:00100000:3.0:1787032238.374490:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 65 00000100:00100000:3.0:1787032238.374502:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+23:10401:x1873838835012608:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032238.374527:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032238.374551:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2855 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.374621:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.374653:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.374665:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032238.374856:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787032238.374860:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032238.374939:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.374968:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2855 expref: 25 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.374987:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2855 expref: 24 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.374996:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032238.374999:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787032238.375003:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418c00, rc 0) 00000100:00100000:3.0:1787032238.375280:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+24:10401:x1873838835012608:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 778us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032238.375287:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 65 00000100:00100000:1.0:1787032238.382980:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.383065:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835012992 00000100:00100000:3.0:1787032238.383092:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835012992 00000100:00100000:3.0:1787032238.383152:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032238.383162:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:10401:x1873838835012992:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032238.384019:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+25:10401:x1873838835012992:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 853us (1047us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787032238.384050:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:2.0:1787032238.387099:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.387274:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835013120 00000100:00100000:1.0:1787032238.387287:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835013120 00000100:00100000:1.0:1787032238.387368:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:1.0:1787032238.387381:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+25:10401:x1873838835013120:12345-192.168.201.48@tcp:103:lfs.0 00010000:00010000:1.0:1787032238.387401:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787032238.387430:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2839 expref: 25 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.387456:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1e9d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b284e expref: 24 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.387598:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1e9bf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27fa expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.387609:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc4f0ad00) 00010000:00010000:1.0:1787032238.387631:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032238.387700:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+22:10401:x1873838835013120:12345-192.168.201.48@tcp:103:lfs.0 Request processed in 321us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032238.387727:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:1.0:1787032238.389897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032238.390040:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835013248 00000100:00100000:2.0:1787032238.390050:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835013248 00000100:00100000:2.0:1787032238.390143:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 66 00000100:00100000:2.0:1787032238.390153:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+22:10401:x1873838835013248:12345-192.168.201.48@tcp:58:lfs.0 00010000:00010000:2.0:1787032238.390297:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.390316:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.390328:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787032238.391216:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787032238.391429:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787032238.391990:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787032238.392361:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+22:10401:x1873838835013248:12345-192.168.201.48@tcp:58:lfs.0 Request processed in 2203us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032238.392372:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 66 00000100:00100000:0.0:1787032238.414258:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.414350:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835013376 00000100:00100000:1.0:1787032238.414362:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835013376 00000100:00100000:1.0:1787032238.414428:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 67 00000100:00100000:1.0:1787032238.414438:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+22:10403:x1873838835013376:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032238.414460:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032238.414481:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b285c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414550:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414565:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414575:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414588:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414595:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414601:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414887:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414905:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414913:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032238.414947:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787032238.414951:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032238.414969:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414982:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414990:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.414997:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415009:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415016:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032238.415020:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415038:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415049:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032238.415052:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032238.415063:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415101:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415114:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415120:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415126:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415132:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032238.415135:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415140:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415148:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff500) 00010000:00010000:1.0:1787032238.415150:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032238.415153:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415157:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415188:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415214:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.415221:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:1.0:1787032238.415223:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787032238.415225:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032238.415294:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+23:10403:x1873838835013376:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 856us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032238.415302:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 67 00000040:00080000:3.0:1787032238.595379:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787032238.595388:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787032238.595462:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787032238.595468:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787032238.595592:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857060352:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787032238.595685:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc80e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787032238.599252:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857060352:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787032238.601245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.601472:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835013504 00000100:00100000:3.0:1787032238.601482:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835013504 00000100:00100000:3.0:1787032238.601578:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:3.0:1787032238.601589:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5d144536-0f5d-43dc-8f25-f68546215872+23:10414:x1873838835013504:12345-192.168.201.48@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787032238.601691:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5d144536-0f5d-43dc-8f25-f68546215872+23:10414:x1873838835013504:12345-192.168.201.48@tcp:900:lhsmtool_posix.0 Request processed in 103us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032238.601699:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:0.0:1787032238.604259:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.604435:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835013632 00000100:00100000:3.0:1787032238.604446:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835013632 00000100:00100000:3.0:1787032238.604513:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 68 00000100:00100000:3.0:1787032238.604523:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+23:10414:x1873838835013632:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787032238.604556:0:5799:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787032238.604666:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+23:10414:x1873838835013632:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 143us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032238.604674:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 68 00000100:00100000:0.0:1787032238.618611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.618687:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835013760 00000100:00100000:1.0:1787032238.618698:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835013760 00000100:00100000:1.0:1787032238.618801:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 69 00000100:00100000:1.0:1787032238.618812:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+23:10414:x1873838835013760:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787032238.618900:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.618918:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.618930:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.618999:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619008:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619034:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619063:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619109:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619117:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032238.619170:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787032238.619175:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032238.619189:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619201:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619207:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619213:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619220:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032238.619224:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619231:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619251:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:1.0:1787032238.619255:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032238.619259:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619266:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9d86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619276:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619282:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619287:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619292:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032238.619295:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619301:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619308:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff99cdce1ff500) 00010000:00010000:1.0:1787032238.619311:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032238.619314:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619320:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9d8d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619342:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619348:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619354:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619359:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032238.619361:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619367:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619375:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:1.0:1787032238.619377:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032238.619380:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.619386:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032238.619455:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+23:10414:x1873838835013760:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 Request processed in 645us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032238.619463:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 69 00000100:00100000:0.0:1787032238.622940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.623027:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835014016 00000100:00100000:3.0:1787032238.623044:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835014016 00000100:00100000:3.0:1787032238.623130:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 70 00000100:00100000:3.0:1787032238.623374:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+23:10414:x1873838835014016:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032238.623397:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032238.623418:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2863 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623526:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623539:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623550:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032238.623561:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787032238.623654:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623661:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623668:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623673:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032238.623677:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623684:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623705:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:3.0:1787032238.623708:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787032238.623712:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623719:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623765:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d9b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2863 expref: 25 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623777:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:3.0:1787032238.623780:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787032238.623783:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9d9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2863 expref: 25 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.623793:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419c00, rc 0) 00000100:00100000:3.0:1787032238.623896:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+24:10414:x1873838835014016:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 756us (962us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787032238.623904:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 70 00000100:00100000:0.0:1787032238.633707:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.633833:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835014144 00000100:00100000:1.0:1787032238.633844:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835014144 00000100:00100000:1.0:1787032238.633901:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 71 00000100:00100000:1.0:1787032238.633919:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+24:10414:x1873838835014144:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787032238.633955:0:7755:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787032238.634114:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+24:10414:x1873838835014144:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 196us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032238.634121:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 71 00000100:00100000:0.0:1787032238.644197:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.644275:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835014400 00000100:00100000:3.0:1787032238.644286:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835014400 00000100:00100000:3.0:1787032238.644532:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 72 00000100:00100000:3.0:1787032238.644544:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:10414:x1873838835014400:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032238.644565:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032238.644568:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787032238.644595:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2855 expref: 24 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.644625:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032238.644630:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032238.644643:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9db0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b286a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787032238.645862:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787032238.646182:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9db7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.646197:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.646208:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.646273:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9db0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b286a expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.646292:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b286a expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.646301:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdcba3a100) 00010000:00010000:3.0:1787032238.646666:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032238.646670:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418000, rc 0) 00000100:00100000:3.0:1787032238.646788:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+25:10414:x1873838835014400:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 2245us (2600us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787032238.646797:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 72 00000100:00100000:0.0:1787032238.668290:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.669231:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835014656 00000100:00100000:1.0:1787032238.669244:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835014656 00000100:00100000:0.0:1787032238.669442:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 73 00000100:00100000:0.0:1787032238.669454:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+25:10414:x1873838835014656:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787032238.669539:0:7755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032238.669567:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1e9db7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b286a expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.669585:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdcba3a100) 00010000:00010000:0.0:1787032238.669595:0:7755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032238.669618:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.669631:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.669641:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.669655:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.669672:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.669679:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670370:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670381:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670388:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670394:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032238.670399:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670407:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670417:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032238.670420:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032238.670424:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670430:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9dc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670440:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670452:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670459:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670464:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032238.670466:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670472:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670479:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcd8c7211 (ffff99cdc4f0a900) 00010000:00010000:0.0:1787032238.670481:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032238.670483:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.670489:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1e9dcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcd8c7211 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032238.670630:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+24:10414:x1873838835014656:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 1177us (2352us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032238.670639:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 73 00000100:00100000:1.0:1787032238.674126:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032238.674360:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835014784 00000100:00100000:0.0:1787032238.674373:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835014784 00000100:00100000:0.0:1787032238.674434:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 74 00000100:00100000:0.0:1787032238.674444:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+24:10414:x1873838835014784:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032238.674465:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032238.674501:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9dd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2871 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.674540:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.674554:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.674565:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.674667:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1e9dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.674685:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 25 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.674693:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:0.0:1787032238.674697:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787032238.674701:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536600, rc 0) 00000100:00100000:0.0:1787032238.674758:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+25:10414:x1873838835014784:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 315us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032238.674765:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 74 00000100:00100000:2.0:1787032238.679847:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.680007:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835015040 00000100:00100000:1.0:1787032238.680026:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835015040 00000100:00100000:1.0:1787032238.680118:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00100000:1.0:1787032238.680128:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+25:10414:x1873838835015040:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787032238.680213:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.680231:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.680241:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787032238.680526:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787032238.680536:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393526467850ns, next at 394526465565ns, rc = 0 00000004:00010000:1.0:1787032238.680623:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021761dd5 reply state 00000000f140c1d6 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032238.680633:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787032238.680739:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+27:10414:x1873838835015040:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 612us (900us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787032238.680762:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00100000:1.0:1787032238.684751:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00010000:00010000:0.0:1787032238.684843:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.684856:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.684864:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.684881:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032238.684886:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.684893:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.684911:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:0.0:1787032238.684914:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787032238.684918:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032238.684925:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9de1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032238.685103:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835015168 00000100:00100000:3.0:1787032238.685113:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835015168 00000100:00100000:2.0:1787032238.685287:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 76 00000100:00100000:2.0:1787032238.685299:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+26:10414:x1873838835015168:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032238.685327:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032238.685344:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2878 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.685402:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.685415:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.685434:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032238.685437:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787032238.685439:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6c00, rc 0) 00000100:00100000:2.0:1787032238.685504:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+27:10414:x1873838835015168:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 207us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032238.685885:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 76 00000100:00100000:2.0:1787032238.691207:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032238.691483:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835015296 00000100:00100000:0.0:1787032238.691497:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835015296 00000100:00100000:0.0:1787032238.691555:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 26 00000100:00100000:0.0:1787032238.691564:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1873838835015296:12345-192.168.201.48@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787032238.691600:0:6584:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:0.0:1787032238.691638:0:6584:0:(genops.c:1406:class_connect()) connect: client 5d144536-0f5d-43dc-8f25-f68546215872, cookie 0xcd047797ef1e9def 00002000:00100000:0.0:1787032238.691655:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d144536-0f5d-43dc-8f25-f68546215872/ffff99cdefc50000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787032238.691668:0:6584:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787032238.691939:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787032238.691985:0:6584:0:(import.c:65:import_set_state_nolock()) ffff99cdefc57000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032238.692375:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2353:x1873838835015296:12345-192.168.201.48@tcp:8:lhsmtool_posix.0 Request processed in 809us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032238.692400:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 26 00000100:00100000:0.0:1787032238.696889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.697651:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835015424 00000100:00100000:3.0:1787032238.697663:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835015424 00000100:00100000:3.0:1787032238.697743:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:3.0:1787032238.697756:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:0:x1873838835015424:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787032238.698136:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032238.767959:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:0:x1873838835015424:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 70194us (71067us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787032238.767974:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 27 00000001:00100000:3.0:1787032238.769137:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000001:00080000:3.0:1787032238.769159:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1787032238.781710:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.781786:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835015680 00000100:00100000:3.0:1787032238.781797:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835015680 00000100:00100000:3.0:1787032238.781892:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:3.0:1787032238.781904:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+27:10414:x1873838835015680:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787032238.782211:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+28:10414:x1873838835015680:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 309us (510us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787032238.782220:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 19 00010000:00010000:0.0:1787032238.785387:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032238.786765:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.787487:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835015936 00000100:00100000:1.0:1787032238.787499:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835015936 00000100:00100000:1.0:1787032238.787566:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 77 00000100:00100000:1.0:1787032238.787577:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+28:10414:x1873838835015936:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787032238.787706:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+28:10414:x1873838835015936:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 130us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032238.787715:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 77 00000100:00100000:2.0:1787032238.793384:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.793520:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835016064 00000100:00100000:3.0:1787032238.793531:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835016064 00000100:00100000:3.0:1787032238.793594:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 78 00000100:00100000:3.0:1787032238.793681:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+28:10414:x1873838835016064:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032238.793708:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032238.793733:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b287f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.793908:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.793925:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.793937:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032238.793976:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032238.793997:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.794044:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b287f expref: 30 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.794064:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b287f expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.794104:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032238.794107:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787032238.794111:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418c00, rc 0) 00000100:00100000:3.0:1787032238.794169:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+29:10414:x1873838835016064:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 567us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032238.794176:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 78 00000100:00100000:2.0:1787032238.809694:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032238.809730:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835016192 00000100:00100000:2.0:1787032238.809739:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835016192 00000100:00100000:2.0:1787032238.809791:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:2.0:1787032238.809800:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838835016192:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032238.809818:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032238.809851:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2886 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787032238.809879:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a83f2ae, blocks: 0x1 00010000:00010000:2.0:1787032238.809898:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1787032238.809903:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032238.809912:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.810241:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032238.810260:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032238.810327:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835016192:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 527us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032238.810335:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:0.0:1787032238.813869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.813963:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835016448 00000100:00100000:3.0:1787032238.813974:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835016448 00000100:00100000:3.0:1787032238.814050:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 79 00000100:00100000:3.0:1787032238.814101:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:10414:x1873838835016448:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787032238.814216:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:10414:x1873838835016448:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032238.814224:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 79 00000100:00100000:2.0:1787032238.834675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.835685:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835016576 00000100:00100000:1.0:1787032238.835700:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835016576 00000100:00100000:1.0:1787032238.835776:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:1.0:1787032238.835786:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:10414:x1873838835016576:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787032238.835807:0:6895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032238.835829:0:6895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b288d expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.835861:0:6895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.835872:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032238.835876:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032238.835882:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 7 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.836339:0:6895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.836356:0:6895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 7 pid: 6587 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032238.836375:0:6895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef129500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857060480:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032238.836566:0:6895:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded1c7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787032238.844576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032238.844687:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835016704 00000100:00100000:1.0:1787032238.844697:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835016704 00010000:00010000:1.0:1787032238.844742:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 8 pid: 6587 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032238.844787:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:1.0:1787032238.844798:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+8:2355:x1873838835016704:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032238.844814:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032238.844839:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 8 pid: 6587 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.844853:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 8 pid: 6587 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.844881:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032238.844886:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032238.844893:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 8 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.844910:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 8 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032238.844962:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 8 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032238.844977:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef12bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1873838857060608:192.168.201.48@tcp:105: 00000100:00100000:1.0:1787032238.845103:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded1c7f00 going to sleep for 11 seconds 00010000:00010000:3.0:1787032238.845505:0:6895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1e9e04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2886 expref: 8 pid: 6587 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032238.845527:0:6895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef129500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857060480:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032238.845553:0:6895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 7 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032238.845614:0:6895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774c00, rc 0) 00000100:00100000:3.0:1787032238.845663:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:10414:x1873838835016576:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 9877us (10998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032238.845671:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:2.0:1787032238.856264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.856517:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835016832 00000100:00100000:3.0:1787032238.856527:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835016832 00002000:00100000:3.0:1787032238.856577:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99cdf4ce0700 x1873838835016832/t0(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:99/0 lens 504/0 e 0 to 0 dl 1787032249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787032238.856588:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdf4ce0700 with x1873838835016832 ext(0->8) 00002000:00010000:3.0:1787032238.856594:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdf4ce0700 00000100:00100000:3.0:1787032238.856639:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:3.0:1787032238.856651:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835016832:12345-192.168.201.48@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787032238.857106:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef12bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1873838857060608:192.168.201.48@tcp:105: 00010000:00010000:1.0:1787032238.857136:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032238.857188:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+8:2355:x1873838835016704:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 12392us (12622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032238.857198:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:3.0:1787032238.857353:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835016832:12345-192.168.201.48@tcp:4:lhsmtool_posix.0 Request processed in 703us (1099us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787032238.857367:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00002000:00100000:3.0:1787032238.857375:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99cdf4ce0700 x1873838835016832/t4294967302(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:99/0 lens 504/448 e 0 to 0 dl 1787032249 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787032238.857383:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdf4ce0700 with x1873838835016832 ext(0->8) 00002000:00010000:3.0:1787032238.857386:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdf4ce0700 00000100:00100000:0.0:1787032238.872873:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032238.873138:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835016960 00000100:00100000:3.0:1787032238.873149:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835016960 00000100:00100000:3.0:1787032238.873219:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 80 00000100:00100000:3.0:1787032238.873229:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+29:10414:x1873838835016960:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787032239.007178:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+29:10414:x1873838835016960:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 Request processed in 133936us (134302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032239.007194:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 80 00000100:00100000:0.0:1787032239.018616:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.018918:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835017088 00000100:00100000:3.0:1787032239.018929:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835017088 00000100:00100000:3.0:1787032239.019000:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 30 00000100:00100000:3.0:1787032239.019022:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835017088:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787032239.022351:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1787032239.022368:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787032239.022412:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1787032239.022431:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1787032239.022593:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857060736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787032239.022671:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787032239.023853:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787032239.023869:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787032239.023892:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857060736 00000100:00100000:3.0:1787032239.023901:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857060736 00000100:00100000:3.0:1787032239.023963:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787032239.023972:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857060736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787032239.027442:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787032239.027454:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787032238 00002000:00010000:3.0:1787032239.027474:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787032239.027476:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787032238 -> 1787032238 00002000:00010000:3.0:1787032239.027478:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787032239.027576:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857060736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3602us (4903us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787032239.027587:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787032239.027631:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787032239.027778:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cdff534e00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787032239.027786:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857060736:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1787032239.164278:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1787032239.164958:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2354:x1873838835017088:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 Request processed in 145940us (146346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032239.164971:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 30 00000100:00100000:2.0:1787032239.172162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.174191:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835017344 00000100:00100000:3.0:1787032239.174218:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835017344 00000100:00100000:3.0:1787032239.174326:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 81 00000100:00100000:3.0:1787032239.174339:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+13:10414:x1873838835017344:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787032239.174410:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032239.174441:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b287f expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.174475:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032239.174480:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032239.174511:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.174525:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.174550:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032239.175063:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001410009c reply state 00000000177de315 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.175284:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787032239.175411:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:10414:x1873838835017344:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 1073us (3260us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787032239.175421:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 81 00000100:00080000:0.0:1787032239.175550:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787032239.177184:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.177201:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.177209:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.177215:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.177222:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.177230:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.177247:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032239.177250:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.177254:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.177277:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.188047:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032239.188497:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835017472 00000100:00100000:0.0:1787032239.188509:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835017472 00000100:00100000:0.0:1787032239.188576:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00100000:0.0:1787032239.188587:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2354:x1873838835017472:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787032239.188962:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787032239.188966:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787032238 -> 1787032237 00002000:00010000:0.0:1787032239.188968:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787032236 00002000:00010000:0.0:1787032239.188971:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787032238 -> 1787032237 00002000:00010000:0.0:1787032239.188973:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787032239.189056:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835017472:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 470us (1020us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787032239.189192:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00100000:3.0:1787032239.194242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032239.194400:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835017728 00000100:00100000:1.0:1787032239.194412:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835017728 00000100:00100000:1.0:1787032239.194489:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 82 00000100:00100000:1.0:1787032239.194500:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+13:10414:x1873838835017728:12345-192.168.201.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787032239.194580:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.194598:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.194608:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.194658:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.194671:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 13 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032239.194687:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef129880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857060864:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032239.195109:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc55540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032239.197348:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef129880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857060864:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032239.197381:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.197636:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032239.197909:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835017856 00000100:00100000:1.0:1787032239.197917:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835017856 00010000:00010000:1.0:1787032239.197953:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 14 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032239.198040:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 43 00000100:00100000:1.0:1787032239.198050:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+14:2354:x1873838835017856:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032239.198100:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032239.198110:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 14 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.198121:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 14 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.198165:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1e9dda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2871 expref: 14 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.198182:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032239.198188:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.198197:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.198205:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.198234:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032239.198286:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+13:2354:x1873838835017856:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 236us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032239.198294:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 43 00010000:00010000:3.0:1787032239.198351:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.198359:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.198391:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.198400:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.198407:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.198413:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.198418:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.198425:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.198434:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032239.198437:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787032239.198440:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.198468:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9e19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.198510:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+12:10414:x1873838835017728:12345-192.168.201.48@tcp:55:lhsmtool_posix.0 Request processed in 4012us (4281us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787032239.198518:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 82 00000100:00100000:2.0:1787032239.207534:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.207603:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835017984 00000100:00100000:3.0:1787032239.207614:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835017984 00000100:00100000:3.0:1787032239.207678:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:3.0:1787032239.207689:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835017984:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787032239.207733:0:6895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.207755:0:6895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 7 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.207776:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787032239.207780:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787032239.207786:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.207822:0:6895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 7 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.207836:0:6895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 7 pid: 6895 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.207873:0:6895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857060992:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032239.207963:0:6895:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded149900 going to sleep for 11 seconds 00000100:00100000:3.0:1787032239.210486:0:6895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857060992:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032239.210526:0:6895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.211879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032239.211958:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835018112 00000100:00100000:0.0:1787032239.211966:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835018112 00010000:00010000:0.0:1787032239.212004:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 8 pid: 6895 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032239.212058:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:0.0:1787032239.212095:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+8:2356:x1873838835018112:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032239.212113:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032239.212138:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 8 pid: 6895 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.212152:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 8 pid: 6895 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.212182:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b99bb2/0xcd047797ef1e9e0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b288d expref: 8 pid: 6895 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.212198:0:11533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032239.212202:0:11533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032239.212208:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.212218:0:11533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.212272:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032239.212328:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:2356:x1873838835018112:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 260us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032239.212336:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 44 00010000:00010000:3.0:1787032239.212360:0:6895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.212370:0:6895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.212397:0:6895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.212405:0:6895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.212413:0:6895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.212419:0:6895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032239.212423:0:6895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.212445:0:6895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.212459:0:6895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.212466:0:6895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1e9e20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.212513:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835017984:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 Request processed in 4826us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032239.212521:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:1.0:1787032239.218445:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032239.218546:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835018368 00000100:00100000:2.0:1787032239.218557:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835018368 00000100:00100000:2.0:1787032239.218621:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 83 00000100:00100000:2.0:1787032239.218632:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+12:10414:x1873838835018368:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787032239.218716:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.218733:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.218746:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.218997:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.219020:0:7755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.219030:0:7755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.219108:0:7755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.219146:0:7755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 13 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.219162:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857061120:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032239.219257:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5422b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032239.224364:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857061120:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032239.224394:0:7755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032239.226122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032239.226329:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835018496 00000100:00100000:2.0:1787032239.226338:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835018496 00010000:00010000:2.0:1787032239.226381:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 14 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.226423:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:2.0:1787032239.226433:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+14:2354:x1873838835018496:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032239.226449:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032239.226455:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 14 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.226468:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 14 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.226489:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9de8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2878 expref: 14 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.226506:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032239.226511:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.226538:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.226547:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.226577:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032239.226634:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+13:2354:x1873838835018496:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 201us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032239.226641:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 45 00010000:00010000:0.0:1787032239.227379:0:7755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.227390:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787032239.227620:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787032239.227780:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787032239.227831:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787032239.227919:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef129c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7755:1873838857061248:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787032239.228002:0:7755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032239.228042:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc893a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032239.229176:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857061248 00000100:00100000:2.0:1787032239.229187:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857061248 00000100:00100000:2.0:1787032239.229283:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032239.229293:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7755:x1873838857061248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787032239.229393:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7755:x1873838857061248:12345-0@lo:1000:mdt00_003.0 Request processed in 101us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032239.229400:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032239.229456:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef129c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7755:1873838857061248:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787032239.232684:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787032239.233509:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7755:1873838857061376:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787032239.233579:0:7755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032239.233618:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd03ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032239.233704:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857061376 00000100:00100000:1.0:1787032239.233712:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857061376 00000100:00100000:1.0:1787032239.233754:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787032239.233768:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7755:x1873838857061376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787032239.234005:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7755:x1873838857061376:12345-0@lo:1000:mdt00_003.0 Request processed in 236us (425us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787032239.234024:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032239.237648:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7755:1873838857061376:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787032239.237711:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237722:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237740:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237747:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032239.237752:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237761:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237778:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032239.237782:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787032239.237786:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237793:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1e9e2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237831:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237838:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237843:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237848:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032239.237851:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237867:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237876:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:2.0:1787032239.237879:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787032239.237882:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237887:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1e9d63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237928:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237943:0:7755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237953:0:7755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.237994:0:7755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.238023:0:7755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 16 pid: 5798 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.238039:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857061504:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032239.238154:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5554c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032239.242676:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032239.243457:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835018624 00000100:00100000:0.0:1787032239.243469:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835018624 00010000:00010000:0.0:1787032239.243517:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 17 pid: 5798 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032239.243558:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:0.0:1787032239.243568:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+17:2354:x1873838835018624:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032239.243584:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032239.243593:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 17 pid: 5798 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.243605:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 17 pid: 5798 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.243641:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:0.0:1787032239.243647:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.243656:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.243663:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.243682:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032239.243744:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+17:2354:x1873838835018624:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 178us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032239.243752:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 46 00010000:00010000:3.0:1787032239.244287:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9d7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b285c expref: 16 pid: 5798 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.244314:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857061504:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032239.244337:0:7755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244349:0:7755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244355:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244368:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244383:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244389:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244396:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.244401:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244409:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244419:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:3.0:1787032239.244422:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.244426:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244432:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1e9e35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244442:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244448:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244454:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244458:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.244468:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244474:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244483:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:3.0:1787032239.244485:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787032239.244488:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.244494:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1e9e27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.244758:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+15:10414:x1873838835018368:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 26126us (26323us total) trans 4294967360 rc 0/0 00000040:00080000:0.0:1787032239.244966:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032239.244972:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032239.245041:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787032239.245048:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787032239.245230:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 83 00000020:00080000:3.0:1787032239.245235:0:7755:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787032239.252319:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032239.255341:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835018880 00000100:00100000:0.0:1787032239.255355:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835018880 00000100:00100000:0.0:1787032239.255426:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:0.0:1787032239.255437:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+15:10414:x1873838835018880:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787032239.256051:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787032239.256190:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787032239.256238:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.256256:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.256272:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.256278:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.256282:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.256286:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.256306:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787032239.256330:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032239.256337:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.256344:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032239.256347:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.256355:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.256369:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99cdc4f0a900) 00010000:00010000:3.0:1787032239.256378:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787032239.256383:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.256388:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1e9e3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032239.256404:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+17:10414:x1873838835018880:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 968us (4093us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1787032239.256406:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032239.256408:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032239.256409:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032239.256412:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 20 00000020:00080000:0.0:1787032239.256418:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1787032239.399648:0:11867:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787032239.399659:0:11867:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787032239.399706:0:11867:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787032239.399713:0:11867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787032239.535235:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032239.535336:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835019136 00000100:00100000:0.0:1787032239.535344:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835019136 00000100:00100000:0.0:1787032239.535394:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 84 00000100:00100000:0.0:1787032239.535402:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+17:10425:x1873838835019136:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032239.535423:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032239.535439:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9e43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2894 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.535677:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9e4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.535690:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.535709:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032239.535720:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787032239.535880:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1e9e43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2894 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.535892:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2894 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.535899:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032239.535901:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787032239.535903:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536c00, rc 0) 00000100:00100000:0.0:1787032239.536140:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+19:10425:x1873838835019136:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 738us (914us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787032239.536145:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 84 00000100:00100000:1.0:1787032239.542600:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.544522:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835019264 00000100:00100000:3.0:1787032239.544535:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835019264 00000100:00100000:3.0:1787032239.544592:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 85 00000100:00100000:3.0:1787032239.544602:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+19:10425:x1873838835019264:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:3.0:1787032239.544677:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.544694:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.544706:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.544721:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.544728:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.544734:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545405:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545415:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545423:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032239.545465:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545479:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545485:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545491:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545496:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.545501:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545507:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545517:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032239.545520:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.545524:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545538:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9e58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545547:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545552:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545557:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545561:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.545563:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545568:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545575:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdcba3a200) 00010000:00010000:3.0:1787032239.545577:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.545580:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545585:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1e9e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545599:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545606:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545618:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545623:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.545626:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545632:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545640:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdcba3a500) 00010000:00010000:3.0:1787032239.545642:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.545645:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.545651:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.545784:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+19:10425:x1873838835019264:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 1181us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032239.545794:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 85 00000100:00100000:3.0:1787032239.610905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032239.620087:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835019520 00000100:00100000:1.0:1787032239.620104:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835019520 00000100:00100000:1.0:1787032239.620165:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00100000:1.0:1787032239.620176:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+19:10428:x1873838835019520:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032239.620198:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032239.620219:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b289b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620297:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620312:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620324:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620338:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620360:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620367:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620712:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620721:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.620728:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032239.620739:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787032239.621967:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.621982:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.621989:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.621995:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032239.621999:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622017:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622047:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032239.622050:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032239.622056:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622063:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9e74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622919:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622928:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622934:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622939:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032239.622943:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622950:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622962:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff700) 00010000:00010000:1.0:1787032239.622964:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032239.622968:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.622974:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.623054:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 22 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.623099:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.623107:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:1.0:1787032239.623109:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032239.623112:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775e00, rc 0) 00000100:00100000:1.0:1787032239.623193:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+21:10428:x1873838835019520:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 3019us (12298us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787032239.623203:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00100000:0.0:1787032239.630748:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032239.630890:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835019648 00000100:00100000:2.0:1787032239.630912:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835019648 00000100:00100000:2.0:1787032239.630979:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 87 00000100:00100000:2.0:1787032239.630991:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+21:10428:x1873838835019648:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:2.0:1787032239.631108:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631126:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631137:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631162:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631169:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631176:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631181:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032239.631185:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631192:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631204:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:2.0:1787032239.631207:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032239.631212:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.631231:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1e9e90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.631303:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+21:10428:x1873838835019648:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 313us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032239.631310:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 87 00000100:00100000:2.0:1787032239.634236:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.634302:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835019904 00000100:00100000:3.0:1787032239.634313:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835019904 00000100:00100000:3.0:1787032239.634374:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:3.0:1787032239.634384:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+21:10428:x1873838835019904:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032239.634631:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+22:10428:x1873838835019904:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 247us (569us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787032239.634655:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:3.0:1787032239.662125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032239.662366:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835020160 00000100:00100000:2.0:1787032239.662377:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835020160 00000100:00100000:2.0:1787032239.662442:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 88 00000100:00100000:2.0:1787032239.662451:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+22:9958:x1873838835020160:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:2.0:1787032239.662476:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032239.662499:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9e97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28a2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.662618:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.662633:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 23 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.662640:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.662674:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 23 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.662686:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 23 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.662716:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857061632:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032239.662823:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded0ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032239.667385:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857061632:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032239.667412:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.669831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032239.672657:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835020288 00000100:00100000:2.0:1787032239.672674:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835020288 00010000:00010000:2.0:1787032239.672726:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 24 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.672776:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:2.0:1787032239.672787:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:2354:x1873838835020288:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032239.672804:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032239.672812:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 24 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.672824:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 24 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.672845:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1e9e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b289b expref: 24 pid: 5799 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.672862:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:2.0:1787032239.672868:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.672877:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.672903:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.672940:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032239.673122:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.673131:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032239.673151:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787032239.673312:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1e9e97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 25 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.673328:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.673335:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:3.0:1787032239.673338:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787032239.673341:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:3.0:1787032239.673370:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:9958:x1873838835020160:12345-192.168.201.48@tcp:101:bash.0 Request processed in 10920us (11257us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787032239.673378:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 88 00000100:00100000:2.0:1787032239.673642:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+23:2354:x1873838835020288:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 227us (3192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032239.673651:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:2.0:1787032239.677263:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.677644:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835020544 00000100:00100000:3.0:1787032239.677654:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835020544 00000100:00100000:3.0:1787032239.677721:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 89 00000100:00100000:3.0:1787032239.677732:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+23:9958:x1873838835020544:12345-192.168.201.48@tcp:36:bash.0 00010000:00010000:3.0:1787032239.678105:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.678137:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.678148:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787032239.678205:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787032239.678232:0:7755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ae6f2dee reply state 000000000f60edcb transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.678242:0:7755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787032239.678295:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787032239.678400:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+27:9958:x1873838835020544:12345-192.168.201.48@tcp:36:bash.0 Request processed in 668us (1146us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787032239.678407:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 89 00000020:00080000:3.0:1787032239.678412:0:7755:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787032239.680277:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.680291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00010000:00010000:0.0:1787032239.680294:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.680302:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.680318:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032239.680323:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.680331:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.680346:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:0.0:1787032239.680350:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032239.680355:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.680361:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9eac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032239.680363:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835020672 00000100:00100000:1.0:1787032239.680371:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835020672 00000100:00100000:1.0:1787032239.680413:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 90 00000100:00100000:1.0:1787032239.680422:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+26:9958:x1873838835020672:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032239.680444:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032239.680462:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9eb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28a9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.680516:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a9 expref: 27 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.680531:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a9 expref: 27 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.680563:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:1.0:1787032239.680566:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787032239.680568:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032239.680631:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+27:9958:x1873838835020672:12345-192.168.201.48@tcp:101:bash.0 Request processed in 210us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032239.680638:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 90 00000100:00100000:2.0:1787032239.682552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.682623:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835020800 00000100:00100000:3.0:1787032239.682631:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835020800 00000100:00100000:3.0:1787032239.682685:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 34 00000100:00100000:3.0:1787032239.682693:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:9958:x1873838835020800:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:3.0:1787032239.682710:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032239.682729:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28b0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787032239.682755:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a83f2ad, atime: 0x6a83f2ac, ctime: 0x6a83f2ad, blocks: 0xb 00010000:00010000:3.0:1787032239.682777:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1787032239.682782:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032239.682792:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.682828:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.682842:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419c00, rc 0) 00000100:00100000:3.0:1787032239.682900:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:9958:x1873838835020800:12345-192.168.201.48@tcp:101:bash.0 Request processed in 207us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032239.682907:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 34 00000100:00100000:2.0:1787032239.687415:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032239.687530:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835020928 00000100:00100000:1.0:1787032239.687541:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835020928 00002000:00010000:1.0:1787032239.687582:0:6590:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787032239.687597:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdf4ce1500 with x1873838835020928 ext(0->18446744073709551615) 00002000:00010000:1.0:1787032239.687609:0:6590:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdf4ce1500. 00000100:00100000:1.0:1787032239.687670:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:1.0:1787032239.687679:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835020928:12345-192.168.201.48@tcp:10:bash.0 00002000:00010000:1.0:1787032239.687962:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787032239.687966:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787032237 -> 1787032239 00002000:00010000:1.0:1787032239.687969:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787032236 -> 1787032236 00002000:00010000:1.0:1787032239.687971:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787032237 -> 1787032239 00002000:00010000:1.0:1787032239.687973:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787032239.688056:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835020928:12345-192.168.201.48@tcp:10:bash.0 Request processed in 377us (650us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787032239.688095:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 1 00002000:00010000:1.0:1787032239.688099:0:6590:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787032239.688102:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdf4ce1500 with x1873838835020928 ext(0->18446744073709551615) 00002000:00010000:1.0:1787032239.688107:0:6590:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdf4ce1500. 00000100:00100000:2.0:1787032239.758418:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.758572:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835021056 00000100:00100000:3.0:1787032239.758583:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835021056 00000100:00100000:3.0:1787032239.758716:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 91 00000100:00100000:3.0:1787032239.758727:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+27:10442:x1873838835021056:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:3.0:1787032239.758810:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.758828:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.758841:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.758855:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.758862:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.758868:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759561:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759574:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759642:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032239.759688:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759700:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759707:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759714:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759720:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.759724:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759730:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759742:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032239.759745:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.759749:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759763:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759779:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759784:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759789:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759794:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.759797:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759803:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759811:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdcba3af00) 00010000:00010000:3.0:1787032239.759814:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.759817:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759823:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759838:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759843:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759854:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759859:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.759862:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759868:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759877:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:3.0:1787032239.759879:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.759881:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.759886:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.760311:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+27:10442:x1873838835021056:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 1580us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032239.760321:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 91 00010000:00010000:0.0:1787032239.809464:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032239.818277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032239.818382:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835021312 00000100:00100000:1.0:1787032239.818393:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835021312 00000100:00100000:1.0:1787032239.818459:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 92 00000100:00100000:1.0:1787032239.818469:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+27:10445:x1873838835021312:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032239.818490:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032239.818511:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ed6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28b7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818596:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818608:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818617:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818626:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818630:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818634:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818933:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9eeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818940:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.818957:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032239.818969:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787032239.819152:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819159:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819163:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819168:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032239.819172:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819178:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819188:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032239.819190:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032239.819193:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819197:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9edd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819206:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819210:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819221:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819225:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032239.819226:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819230:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819234:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff700) 00010000:00010000:1.0:1787032239.819235:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032239.819237:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819240:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819281:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ed6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b7 expref: 30 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819292:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b7 expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.819297:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:1.0:1787032239.819299:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787032239.819301:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775600, rc 0) 00000100:00100000:1.0:1787032239.819371:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+29:10445:x1873838835021312:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 905us (1104us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787032239.819384:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 92 00000100:00100000:2.0:1787032239.831353:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032239.831563:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835021440 00000100:00100000:1.0:1787032239.831573:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835021440 00000100:00100000:1.0:1787032239.831638:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 93 00000100:00100000:1.0:1787032239.831645:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:10445:x1873838835021440:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:1.0:1787032239.831709:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.831722:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.831729:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.831759:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 29 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.831773:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 29 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032239.831788:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef128700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857061760:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032239.831869:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc80e1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032239.834335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.834393:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835021696 00000100:00100000:3.0:1787032239.834400:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835021696 00000100:00100000:3.0:1787032239.834449:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:3.0:1787032239.834456:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+30:5569:x1873838835021696:12345-192.168.201.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787032239.834717:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+31:5569:x1873838835021696:12345-192.168.201.48@tcp:35:ldlm_bl.0 Request processed in 261us (389us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787032239.834723:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:1.0:1787032239.835163:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef128700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857061760:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032239.835184:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.836926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032239.837041:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835021824 00000100:00100000:0.0:1787032239.837049:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835021824 00010000:00010000:0.0:1787032239.837115:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 31 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032239.837137:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:0.0:1787032239.837143:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+31:2355:x1873838835021824:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032239.837154:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032239.837159:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 31 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.837167:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 31 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.837196:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1e9e9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a2 expref: 31 pid: 5797 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.837208:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:0.0:1787032239.837212:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.837219:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.837225:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032239.837251:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032239.837291:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+30:2355:x1873838835021824:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 149us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032239.837296:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 48 00010000:00010000:2.0:1787032239.837740:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.837746:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.837775:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.837782:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.837788:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.837802:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032239.837807:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.837813:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.837821:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:2.0:1787032239.837823:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032239.837825:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032239.837829:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.837871:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:10445:x1873838835021440:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 6226us (6530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032239.837876:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 93 00000100:00100000:2.0:1787032239.839241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.839293:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835022080 00000100:00100000:3.0:1787032239.839298:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835022080 00000100:00100000:3.0:1787032239.839331:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:3.0:1787032239.839336:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:10445:x1873838835022080:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032239.839541:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+30:10445:x1873838835022080:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 204us (304us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787032239.839546:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:0.0:1787032239.920549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032239.920859:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835022336 00000100:00100000:1.0:1787032239.920882:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835022336 00000100:00100000:1.0:1787032239.921168:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 94 00000100:00100000:1.0:1787032239.921179:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+30:10456:x1873838835022336:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:1.0:1787032239.921205:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032239.921226:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9f00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28be expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.921336:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.921353:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.921365:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.921381:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.921389:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.921396:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922187:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922198:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922206:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032239.922223:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787032239.922308:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922315:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922321:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922328:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032239.922331:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922338:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922349:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032239.922352:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032239.922356:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922362:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922372:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922378:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922394:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922398:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032239.922401:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922406:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922414:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff700) 00010000:00010000:1.0:1787032239.922416:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032239.922419:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.922424:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.923409:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1e9f00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28be expref: 33 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.923443:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28be expref: 32 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.923451:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:1.0:1787032239.923454:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032239.923457:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775a00, rc 0) 00000100:00100000:1.0:1787032239.923540:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+32:10456:x1873838835022336:12345-192.168.201.48@tcp:101:cat.0 Request processed in 2362us (3012us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787032239.923561:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 94 00000100:00100000:2.0:1787032239.929485:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.929738:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835022592 00000100:00100000:3.0:1787032239.929808:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835022592 00000100:00100000:3.0:1787032239.929929:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:3.0:1787032239.929941:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+32:10456:x1873838835022592:12345-192.168.201.48@tcp:35:cat.0 00000100:00100000:3.0:1787032239.930282:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+33:10456:x1873838835022592:12345-192.168.201.48@tcp:35:cat.0 Request processed in 343us (807us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787032239.930290:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:2.0:1787032239.944615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.944725:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835022848 00000100:00100000:3.0:1787032239.944735:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835022848 00000100:00100000:3.0:1787032239.944899:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 95 00000100:00100000:3.0:1787032239.944918:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+33:10457:x1873838835022848:12345-192.168.201.48@tcp:36:rm.0 00010000:00010000:3.0:1787032239.944991:0:7755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787032239.945037:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28be expref: 33 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945060:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9eeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b7 expref: 32 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945125:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9eb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28a9 expref: 31 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945150:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:3.0:1787032239.945161:0:7755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032239.945184:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945198:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945206:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945220:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945226:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945233:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945558:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945567:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.945575:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787032239.948198:0:7755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1787032239.948216:0:7755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394794147043ns, next at 395794143078ns, rc = 0 00010000:00010000:3.0:1787032239.948327:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948345:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948356:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948365:0:7755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948371:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948377:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948735:0:7755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787032239.948815:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948823:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948829:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948835:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.948840:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948848:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948868:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdcba3ad00) 00010000:00010000:3.0:1787032239.948871:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787032239.948875:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948881:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948900:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948906:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948911:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948916:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.948919:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948925:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948931:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032239.948933:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.948936:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.948940:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032239.948960:0:7755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a37adcd reply state 000000005f0cf9d6 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032239.948969:0:7755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787032239.949256:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+32:10457:x1873838835022848:12345-192.168.201.48@tcp:36:rm.0 Request processed in 4344us (4648us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787032239.949266:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 95 00010000:00010000:1.0:1787032239.950344:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032239.950354:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.950361:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032239.950365:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.950374:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.950385:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99cdcba3ad00) 00010000:00010000:1.0:1787032239.950388:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787032239.950391:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.950398:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9f38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032239.950419:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032239.950420:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032239.950422:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032239.954322:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.954339:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.954345:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.954351:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032239.954356:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.954363:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.954379:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdcba3af00) 00010000:00010000:3.0:1787032239.954382:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032239.954387:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032239.954393:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032239.999184:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032239.999682:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835023104 00000100:00100000:3.0:1787032239.999694:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835023104 00000100:00100000:3.0:1787032239.999812:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 96 00000100:00100000:3.0:1787032239.999820:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+31:10463:x1873838835023104:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:3.0:1787032239.999841:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032239.999860:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28c5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.000005:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.000031:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.000044:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.000061:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.000105:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.000112:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787032240.002237:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787032240.002394:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002421:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002886:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002931:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002938:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002945:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002951:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032240.002955:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002962:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002976:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032240.002979:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032240.002984:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.002990:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032240.003014:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004901245f reply state 000000008b679107 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.003031:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787032240.003064:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 34 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.003112:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.003118:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:3.0:1787032240.003119:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032240.003121:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418a00, rc 0) 00000100:00100000:3.0:1787032240.003189:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+34:10463:x1873838835023104:12345-192.168.201.48@tcp:101:bash.0 Request processed in 3371us (4021us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787032240.003196:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 96 00000100:00100000:2.0:1787032240.010101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.010425:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835023232 00000100:00100000:3.0:1787032240.010444:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835023232 00000100:00100000:3.0:1787032240.010521:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 35 00000100:00100000:3.0:1787032240.010531:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835023232:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:3.0:1787032240.010551:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032240.010573:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28cc expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787032240.010610:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787032240.010627:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1787032240.010631:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032240.010641:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.010675:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.010689:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419000, rc 0) 00000100:00100000:3.0:1787032240.010737:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835023232:12345-192.168.201.48@tcp:101:bash.0 Request processed in 208us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032240.010744:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 35 00000100:00080000:2.0:1787032240.011473:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032240.014899:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00010000:00010000:0.0:1787032240.015133:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.015147:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.015154:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.015161:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032240.015165:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.015190:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.015206:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdcba3af00) 00010000:00010000:0.0:1787032240.015209:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032240.015215:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.015221:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9f4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.015384:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835023360 00000100:00100000:1.0:1787032240.015394:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835023360 00000100:00100000:1.0:1787032240.015604:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:1.0:1787032240.015615:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:10463:x1873838835023360:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032240.015632:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032240.015647:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28d3 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.015691:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 9 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.015699:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032240.015703:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032240.015708:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.015742:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 9 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.015755:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 9 pid: 6587 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.015769:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef128700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6584:1873838857061888:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032240.015862:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc80e1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032240.020712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.020797:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835023488 00000100:00100000:3.0:1787032240.020808:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835023488 00010000:00010000:3.0:1787032240.020852:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 10 pid: 6587 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.020897:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:3.0:1787032240.020907:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b49050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+10:2355:x1873838835023488:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787032240.020936:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032240.020961:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 10 pid: 6587 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.020976:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 10 pid: 6587 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.021019:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032240.021024:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032240.021034:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 10 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.021063:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 10 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.021140:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 10 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.021156:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1873838857062016:192.168.201.48@tcp:105: 00000100:00100000:3.0:1787032240.021232:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032240.024265:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5782:1873838857062016:192.168.201.48@tcp:105: 00010000:00010000:0.0:1787032240.024292:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032240.024342:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b49050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+10:2355:x1873838835023488:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 3435us (3639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032240.024352:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 49 00010000:00010000:1.0:1787032240.027242:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7728bd3/0xcd047797ef1e9f62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28cc expref: 9 pid: 6587 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.027271:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef128700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6584:1873838857061888:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032240.027303:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.027318:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775c00, rc 0) 00000100:00100000:1.0:1787032240.027573:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:10463:x1873838835023360:12345-192.168.201.48@tcp:101:bash.0 Request processed in 11959us (12682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.027592:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:2.0:1787032240.031691:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.031786:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835023744 00000100:00100000:0.0:1787032240.031797:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835023744 00000100:00100000:0.0:1787032240.031900:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 25 00000100:00100000:0.0:1787032240.031921:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+33:10463:x1873838835023744:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:0.0:1787032240.032518:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+34:10463:x1873838835023744:12345-192.168.201.48@tcp:35:bash.0 Request processed in 607us (836us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787032240.032526:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 25 00000100:00100000:2.0:1787032240.244618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032240.244722:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835023872 00000100:00100000:1.0:1787032240.244734:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835023872 00000100:00100000:1.0:1787032240.244805:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 97 00000100:00100000:1.0:1787032240.244815:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+34:10479:x1873838835023872:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032240.244840:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032240.244866:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28da expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.244969:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.244984:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.245302:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032240.245368:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787032240.245373:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032240.245397:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.245423:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28da expref: 36 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.245443:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28da expref: 35 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.245472:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032240.245475:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787032240.245479:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774c00, rc 0) 00000100:00100000:1.0:1787032240.245544:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+35:10479:x1873838835023872:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 729us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.245552:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 97 00000100:00100000:2.0:1787032240.257038:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000040:00080000:0.0:1787032240.257273:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032240.257279:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032240.257329:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787032240.257335:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787032240.257442:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835024128 00000100:00100000:1.0:1787032240.257453:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835024128 00000100:00100000:1.0:1787032240.257512:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 98 00000100:00100000:1.0:1787032240.257524:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+35:10479:x1873838835024128:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032240.257556:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032240.257580:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28e1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.257679:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9f85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.257693:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.257704:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032240.257716:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787032240.258503:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1e9f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28e1 expref: 38 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.258543:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9f85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28e1 expref: 37 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.258853:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:1.0:1787032240.258857:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032240.258860:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032240.259382:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+37:10479:x1873838835024128:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1855us (2351us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787032240.259391:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 98 00000100:00100000:2.0:1787032240.266786:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.267054:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835024384 00000100:00100000:3.0:1787032240.267097:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835024384 00000100:00100000:3.0:1787032240.267166:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 99 00000100:00100000:3.0:1787032240.267176:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+37:10479:x1873838835024384:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032240.267201:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032240.267225:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28e8 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.267329:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.267345:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.267358:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032240.267371:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787032240.268095:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1e9f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28e8 expref: 40 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.268116:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28e8 expref: 39 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.268125:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:3.0:1787032240.268128:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787032240.268132:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419a00, rc 0) 00000100:00100000:3.0:1787032240.268379:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+39:10479:x1873838835024384:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1202us (1599us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787032240.268387:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 99 00000100:00100000:2.0:1787032240.276941:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032240.277000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.277201:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835024512 00000100:00100000:0.0:1787032240.277212:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835024512 00000100:00100000:0.0:1787032240.277281:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:0.0:1787032240.277291:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+39:2355:x1873838835024512:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032240.277308:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032240.277335:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1e9f85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28e1 expref: 39 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.277356:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:0.0:1787032240.277361:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032240.277416:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+38:2355:x1873838835024512:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 126us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032240.277424:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:3.0:1787032240.277712:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835024640 00000100:00100000:3.0:1787032240.277717:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835024640 00000100:00100000:3.0:1787032240.277769:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:3.0:1787032240.277777:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:2357:x1873838835024640:12345-192.168.201.48@tcp:1:lfs.0 00010000:00010000:3.0:1787032240.277818:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.277837:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.277846:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787032240.277850:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787032240.277855:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.277888:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.277930:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 8 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.277946:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6587:1873838857062144:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032240.278031:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42480 going to sleep for 11 seconds 00000100:00100000:3.0:1787032240.282740:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6587:1873838857062144:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032240.282779:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032240.285055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032240.285292:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835024768 00000100:00100000:1.0:1787032240.285301:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835024768 00002000:00100000:1.0:1787032240.285353:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99cdfadbc700 x1873838835024768/t0(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:101/0 lens 504/0 e 0 to 0 dl 1787032251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032240.285363:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdfadbc700 with x1873838835024768 ext(0->8) 00010000:00010000:1.0:1787032240.285372:0:6591:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 9 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.285388:0:6591:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 9 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787032240.285395:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99cdfadbc700 00000100:00100000:1.0:1787032240.285419:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:1.0:1787032240.285436:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d144536-0f5d-43dc-8f25-f68546215872+9:2355:x1873838835024768:12345-192.168.201.48@tcp:4:lfs.0 00000100:00100000:1.0:1787032240.285966:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d144536-0f5d-43dc-8f25-f68546215872+11:2355:x1873838835024768:12345-192.168.201.48@tcp:4:lfs.0 Request processed in 537us (916us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787032240.285981:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 1 00002000:00100000:1.0:1787032240.285999:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99cdfadbc700 x1873838835024768/t4294967302(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:101/0 lens 504/448 e 0 to 0 dl 1787032251 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032240.286007:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdfadbc700 with x1873838835024768 ext(0->8) 00010000:00010000:1.0:1787032240.286012:0:6591:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 11 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.286024:0:6591:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 11 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787032240.286031:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99cdfadbc700 00000100:00100000:2.0:1787032240.290404:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.290492:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835024896 00000100:00100000:0.0:1787032240.290502:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835024896 00010000:00010000:0.0:1787032240.290553:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 11 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032240.290605:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 50 00000100:00100000:0.0:1787032240.290616:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+11:2357:x1873838835024896:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032240.290633:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787032240.290656:0:5784:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787032240.290658:0:5784:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787032239 00002000:00010000:0.0:1787032240.290661:0:5784:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787032239 00002000:00010000:0.0:1787032240.290663:0:5784:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787032239 00010000:00010000:0.0:1787032240.290670:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 11 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.290703:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 11 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.290730:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1e9f69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28d3 expref: 11 pid: 6584 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.290756:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032240.290760:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032240.290766:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.290776:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.290817:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032240.290870:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+10:2357:x1873838835024896:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 255us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032240.290879:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 50 00010000:00010000:1.0:1787032240.291103:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.291113:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.291137:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.291145:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.291152:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.291172:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032240.291176:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.291184:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.291195:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.291203:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a23b85e/0xcd047797ef1e9fa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.291249:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:2357:x1873838835024640:12345-192.168.201.48@tcp:1:lfs.0 Request processed in 13473us (14248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.291256:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:2.0:1787032240.296176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.296346:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835025152 00000100:00100000:3.0:1787032240.296357:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835025152 00000100:00100000:3.0:1787032240.296467:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 26 00000100:00100000:3.0:1787032240.296478:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+38:10479:x1873838835025152:12345-192.168.201.48@tcp:35:lfs.0 00000004:00010000:3.0:1787032240.296555:0:5801:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28e8 expref: 38 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787032240.296833:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787032240.296881:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787032240.297272:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787032240.297328:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.297344:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.297371:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.297403:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.297418:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 42 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.297433:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef136300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1873838857062272:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032240.297525:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42480 going to sleep for 11 seconds 00000100:00100000:2.0:1787032240.302344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032240.302556:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835025280 00000100:00100000:1.0:1787032240.302567:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835025280 00010000:00010000:1.0:1787032240.302612:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 43 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.302656:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00100000:1.0:1787032240.302666:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+43:2354:x1873838835025280:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032240.302683:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032240.302690:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 43 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.302716:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 43 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.302738:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:1.0:1787032240.302757:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.302766:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.302772:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.302792:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032240.302843:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+43:2354:x1873838835025280:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 178us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.302851:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 51 00010000:00010000:3.0:1787032240.304530:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28c5 expref: 42 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.304569:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef136300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1873838857062272:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032240.304603:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.304612:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.304618:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787032240.305196:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787032240.305398:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787032240.305534:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef136300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857062400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787032240.305622:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032240.305647:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032240.306181:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857062400 00000100:00100000:1.0:1787032240.306190:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857062400 00000100:00100000:1.0:1787032240.306244:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787032240.306252:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5801:x1873838857062400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787032240.306332:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5801:x1873838857062400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.306339:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787032240.306463:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032240.306704:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef136300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857062400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787032240.307586:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787032240.307671:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef136300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857062528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787032240.307719:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032240.307758:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42480 going to sleep for 11 seconds 00000100:00100000:2.0:1787032240.308119:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857062528 00000100:00100000:2.0:1787032240.308127:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857062528 00000100:00100000:2.0:1787032240.308167:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787032240.308175:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5801:x1873838857062528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787032240.308349:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5801:x1873838857062528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 174us (629us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787032240.308356:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787032240.308445:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef136300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857062528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787032240.308496:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787032240.308534:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.308544:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.308581:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.308588:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032240.308592:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.308601:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.308617:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:0.0:1787032240.308620:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787032240.308624:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.308630:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1e9faf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787032240.308792:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787032240.308885:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787032240.308894:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395154826104ns, next at 396154824454ns, rc = 0 00000001:00080000:0.0:1787032240.308900:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787032240.308926:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:0.0:1787032240.308929:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787032240.308936:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1e9f9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28e8 expref: 46 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032240.309056:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+45:10479:x1873838835025152:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 12578us (12889us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787032240.309112:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 26 00000020:00080000:0.0:1787032240.309116:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787032240.313715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.314024:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835025408 00000100:00100000:3.0:1787032240.314038:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835025408 00000100:00100000:3.0:1787032240.314149:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 100 00000100:00100000:3.0:1787032240.314160:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+45:10479:x1873838835025408:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032240.314190:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032240.314218:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9fb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28ef expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.314298:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28ef expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.314314:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9fb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28ef expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.314335:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032240.314338:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787032240.314342:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419000, rc 0) 00000100:00100000:3.0:1787032240.314416:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+46:10479:x1873838835025408:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 258us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032240.314433:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 100 00000100:00100000:2.0:1787032240.320539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.321717:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835025664 00000100:00100000:0.0:1787032240.321730:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835025664 00000100:00100000:0.0:1787032240.321867:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:0.0:1787032240.321877:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+46:10479:x1873838835025664:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:0.0:1787032240.322251:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+47:10479:x1873838835025664:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 374us (1722us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787032240.322259:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:0.0:1787032240.440564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032240.440826:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835025792 00000100:00100000:1.0:1787032240.440839:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835025792 00000100:00100000:1.0:1787032240.440926:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 101 00000100:00100000:1.0:1787032240.440937:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+47:10489:x1873838835025792:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:1.0:1787032240.441117:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441137:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441150:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441166:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441174:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441179:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441288:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441297:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441303:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032240.441352:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441367:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441390:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441397:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441403:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032240.441408:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441416:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441442:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032240.441446:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032240.441450:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441457:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1e9fbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441471:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441476:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441482:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441487:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032240.441498:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441505:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441513:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdce1ff700) 00010000:00010000:1.0:1787032240.441516:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032240.441519:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441525:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9fc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441540:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441556:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441562:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441568:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032240.441571:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441584:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441592:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032240.441594:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032240.441615:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.441621:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1e9fcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.441705:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+47:10489:x1873838835025792:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 769us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.441713:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 101 00000100:00100000:2.0:1787032240.517011:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.518327:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835026048 00000100:00100000:3.0:1787032240.518342:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835026048 00000100:00100000:3.0:1787032240.518415:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 102 00000100:00100000:3.0:1787032240.518426:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+47:10492:x1873838835026048:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032240.518451:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032240.518475:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9fd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28f6 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518567:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518702:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518714:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518735:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518752:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518758:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518889:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518897:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.518925:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032240.518936:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787032240.519405:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519416:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519422:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519429:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032240.519433:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519441:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519456:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032240.519459:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032240.519463:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519469:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1e9fd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519483:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519490:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519503:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519507:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032240.519510:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519516:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519524:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdcba3ae00) 00010000:00010000:3.0:1787032240.519527:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032240.519530:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519536:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1e9fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519796:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1e9fd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 50 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519815:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 49 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.519822:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032240.519824:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032240.519827:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418c00, rc 0) 00000100:00100000:3.0:1787032240.519980:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+49:10492:x1873838835026048:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1555us (3007us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787032240.520020:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 102 00000100:00100000:2.0:1787032240.524244:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032240.524345:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835026176 00000100:00100000:1.0:1787032240.524355:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835026176 00000100:00100000:1.0:1787032240.524413:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 103 00000100:00100000:1.0:1787032240.524420:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+49:10492:x1873838835026176:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:1.0:1787032240.524616:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524635:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524647:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524678:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524684:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524689:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524693:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032240.524708:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524713:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524723:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032240.524725:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787032240.524728:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.524732:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ff5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.524805:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+49:10492:x1873838835026176:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 383us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.524813:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 103 00000100:00100000:1.0:1787032240.527519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.528279:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835026432 00000100:00100000:3.0:1787032240.528290:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835026432 00000100:00100000:3.0:1787032240.528395:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:3.0:1787032240.528406:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+49:10492:x1873838835026432:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032240.528676:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+50:10492:x1873838835026432:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 271us (1255us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787032240.528685:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:2.0:1787032240.605297:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032240.605466:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835026688 00000100:00100000:1.0:1787032240.605478:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835026688 00000100:00100000:1.0:1787032240.605545:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 104 00000100:00100000:1.0:1787032240.605556:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+50:10502:x1873838835026688:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032240.605592:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032240.605596:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787032240.605626:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1e9f77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28da expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.605646:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:1.0:1787032240.605651:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032240.605679:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ffc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b28fd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.605789:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.605804:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 50 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.605813:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.605852:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 50 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.605865:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 50 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.605879:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef12aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857062656:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032240.606024:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc80e1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787032240.613565:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef12aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857062656:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032240.613616:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032240.617666:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.617846:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835026816 00000100:00100000:0.0:1787032240.617856:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835026816 00010000:00010000:0.0:1787032240.617904:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 51 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032240.617958:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00100000:0.0:1787032240.617969:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+51:2355:x1873838835026816:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032240.618015:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032240.618023:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 51 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.618038:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 51 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.618065:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1e9fe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28f6 expref: 51 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.618150:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:0.0:1787032240.618155:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.618166:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.618175:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.618216:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032240.618288:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+50:2355:x1873838835026816:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 320us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032240.618297:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 52 00010000:00010000:1.0:1787032240.619799:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.619815:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032240.619851:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787032240.620465:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1e9ffc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 51 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.620491:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 50 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.620501:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032240.620504:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787032240.620508:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775600, rc 0) 00000100:00100000:1.0:1787032240.620730:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+50:10502:x1873838835026688:12345-192.168.201.48@tcp:101:bash.0 Request processed in 15174us (15445us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787032240.620745:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 104 00000100:00100000:2.0:1787032240.635026:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.639433:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835027072 00000100:00100000:3.0:1787032240.639458:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835027072 00000100:00100000:3.0:1787032240.639549:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 105 00000100:00100000:3.0:1787032240.639562:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+50:10502:x1873838835027072:12345-192.168.201.48@tcp:36:bash.0 00010000:00010000:3.0:1787032240.639887:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.639907:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.639919:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787032240.639976:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787032240.640015:0:7755:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005cf327f8 reply state 00000000ca6cad74 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.640025:0:7755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787032240.640167:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+53:10502:x1873838835027072:12345-192.168.201.48@tcp:36:bash.0 Request processed in 606us (5152us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787032240.640192:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 105 00000020:00080000:3.0:1787032240.640198:0:7755:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787032240.644677:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.645038:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835027200 00000100:00100000:0.0:1787032240.645052:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835027200 00000100:00100000:0.0:1787032240.645152:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 106 00000100:00100000:0.0:1787032240.645164:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+53:10502:x1873838835027200:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032240.645198:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032240.645225:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2904 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.645347:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.645364:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 54 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.645397:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.645406:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.645721:0:5797:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.645763:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 54 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.645776:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 54 pid: 5799 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032240.645792:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857062784:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032240.645882:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6f840 going to sleep for 11 seconds 00010000:00010000:3.0:1787032240.653157:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.653181:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.653190:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.653197:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032240.653203:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.653211:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.653231:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032240.653235:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032240.653238:0:3288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.653250:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.653257:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea011 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032240.657386:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.657965:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857062784:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032240.658009:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.660919:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835027328 00000100:00100000:3.0:1787032240.660937:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835027328 00010000:00010000:2.0:1787032240.665333:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 54 pid: 5799 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032240.665624:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:2.0:1787032240.665651:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+54:2354:x1873838835027328:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032240.665669:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032240.665676:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 54 pid: 5799 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032240.665690:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 54 pid: 5799 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032240.665713:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea003 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28fd expref: 54 pid: 5799 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032240.665730:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:2.0:1787032240.665808:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032240.665819:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032240.665827:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032240.665863:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032240.666097:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.666106:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032240.666159:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787032240.666173:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032240.666199:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.666235:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.666250:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.666257:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:0.0:1787032240.666260:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032240.666262:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537c00, rc 0) 00000100:00100000:2.0:1787032240.666356:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+53:2354:x1873838835027328:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 708us (8984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032240.666365:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:0.0:1787032240.676461:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+52:10502:x1873838835027200:12345-192.168.201.48@tcp:101:bash.0 Request processed in 31271us (31766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032240.676477:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 106 00000100:00100000:2.0:1787032240.692261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.692355:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835027584 00000100:00100000:0.0:1787032240.692366:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835027584 00000100:00100000:0.0:1787032240.692443:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:0.0:1787032240.692454:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+52:10502:x1873838835027584:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:0.0:1787032240.692720:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+53:10502:x1873838835027584:12345-192.168.201.48@tcp:35:bash.0 Request processed in 266us (469us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787032240.692729:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:1.0:1787032240.772220:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.772319:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835027840 00000100:00100000:3.0:1787032240.772332:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835027840 00000100:00100000:3.0:1787032240.772478:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00100000:3.0:1787032240.772489:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+8:2356:x1873838835027840:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032240.772593:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+8:2356:x1873838835027840:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 105us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032240.772602:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00080000:2.0:1787032240.774966:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032240.785351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032240.785456:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032240.785518:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.785604:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835027968 00000100:00100000:0.0:1787032240.785616:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835027968 00000100:00100000:0.0:1787032240.785686:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835028096 00000100:00100000:0.0:1787032240.785690:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835028096 00000100:00100000:0.0:1787032240.785713:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 135 00000100:00100000:0.0:1787032240.785724:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838835027968:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032240.785824:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838835027968:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 102us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032240.785831:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 135 00000100:00100000:0.0:1787032240.785850:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 107 00000100:00100000:0.0:1787032240.785856:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+53:10508:x1873838835028096:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032240.785873:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032240.785908:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b290b expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.785975:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea02d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.786002:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.786019:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032240.786124:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787032240.786130:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032240.786155:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.786184:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b290b expref: 55 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.786204:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea02d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b290b expref: 54 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.786225:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032240.786229:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787032240.786233:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537800, rc 0) 00000100:00100000:0.0:1787032240.786255:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+54:10508:x1873838835028096:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 400us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032240.786262:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 107 00000100:00080000:2.0:1787032240.786472:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032240.788659:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835027712 00000100:00100000:1.0:1787032240.788674:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835027712 00000100:00100000:1.0:1787032240.788787:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 285 00000100:00100000:1.0:1787032240.788796:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835027712:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032240.788866:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835027712:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 72us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.788873:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 285 00000100:00100000:3.0:1787032240.789489:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.789519:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835028224 00000100:00100000:3.0:1787032240.789524:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835028224 00000100:00100000:3.0:1787032240.789572:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 108 00000100:00100000:3.0:1787032240.789579:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+54:10508:x1873838835028224:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032240.789598:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032240.789619:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea034 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2912 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789689:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789703:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789715:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789742:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789750:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789774:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789904:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789914:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.789921:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032240.789961:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787032240.789965:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032240.789997:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790010:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790019:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790025:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790032:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790039:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032240.790043:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790058:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790101:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032240.790105:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032240.790110:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790116:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea03b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790131:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790136:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790143:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790148:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032240.790150:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790155:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790161:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdcba3ae00) 00010000:00010000:3.0:1787032240.790164:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032240.790167:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790183:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790216:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea034 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 56 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790230:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 55 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032240.790238:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032240.790240:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032240.790243:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418800, rc 0) 00000100:00100000:3.0:1787032240.790299:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+55:10508:x1873838835028224:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 719us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032240.790306:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 108 00000100:00100000:3.0:1787032240.797522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032240.797575:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.797712:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835028480 00000100:00100000:0.0:1787032240.797726:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835028480 00000100:00100000:0.0:1787032240.797791:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 109 00000100:00100000:0.0:1787032240.797800:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+55:10508:x1873838835028480:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032240.797823:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032240.797845:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2919 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.798187:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835028608 00000100:00100000:1.0:1787032240.798193:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835028608 00010000:00010000:0.0:1787032240.798347:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.798366:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.798374:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 57 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.798381:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00100000:0.0:1787032240.798406:0:5799:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xcd047797ef1ea049 req@ffff99cdca071880 x1873838835028608/t0(0) o103->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:101/0 lens 328/0 e 0 to 0 dl 1787032251 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787032240.798452:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 57 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.798467:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 57 pid: 7755 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032240.798481:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857062912:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032240.798589:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.798598:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 57 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032240.798607:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff535500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857063040:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032240.798633:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787032240.798754:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 54 00000100:00100000:1.0:1787032240.798763:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+57:2355:x1873838835028608:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032240.798786:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032240.798793:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 57 pid: 7755 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.798805:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 57 pid: 7755 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.798824:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032240.798829:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.798836:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.798842:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032240.798869:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+57:2355:x1873838835028608:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 108us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.798877:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 54 00010000:00010000:1.0:1787032240.800999:0:5799:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.48@tcp) returned -22 from blocking AST (req@000000007e7130b1 x1873838857062912) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 56 pid: 7755 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801156:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2912 expref: 56 pid: 7755 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.801174:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857062912:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032240.801191:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff535500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857063040:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032240.801217:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032240.801238:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801246:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801255:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032240.801397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032240.801439:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835028736 00000100:00100000:1.0:1787032240.801446:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835028736 00010000:00010000:1.0:1787032240.801483:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 56 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032240.801581:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 55 00000100:00100000:1.0:1787032240.801590:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+56:2355:x1873838835028736:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032240.801606:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032240.801611:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 56 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801624:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 56 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801646:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea01f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2904 expref: 56 pid: 5797 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801657:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032240.801662:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801682:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801689:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.801719:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032240.801785:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+55:2355:x1873838835028736:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 196us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.801793:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 55 00010000:00010000:0.0:1787032240.802150:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.802159:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032240.802178:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787032240.802332:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 56 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.802351:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 55 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.802371:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:0.0:1787032240.802374:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787032240.802376:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536a00, rc 0) 00000100:00100000:0.0:1787032240.802415:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+55:10508:x1873838835028480:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 4616us (4902us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787032240.802422:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 109 00000100:00100000:3.0:1787032240.806597:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032240.806849:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835028992 00000100:00100000:2.0:1787032240.806861:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835028992 00000100:00100000:2.0:1787032240.806998:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:2.0:1787032240.807018:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+55:10508:x1873838835028992:12345-192.168.201.48@tcp:103:lfs.0 00010000:00010000:2.0:1787032240.807037:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032240.807102:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1e9fb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28ef expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032240.807126:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:2.0:1787032240.807132:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032240.807201:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+54:10508:x1873838835028992:12345-192.168.201.48@tcp:103:lfs.0 Request processed in 195us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032240.807208:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:3.0:1787032240.810222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032240.810651:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835029120 00000100:00100000:0.0:1787032240.810662:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835029120 00000100:00100000:0.0:1787032240.810726:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 110 00000100:00100000:0.0:1787032240.810735:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+54:10508:x1873838835029120:12345-192.168.201.48@tcp:58:lfs.0 00010000:00010000:0.0:1787032240.810867:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.810884:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032240.810896:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787032240.811124:0:7755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787032240.811217:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+54:10508:x1873838835029120:12345-192.168.201.48@tcp:58:lfs.0 Request processed in 482us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032240.811225:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 110 00000100:00100000:3.0:1787032240.813270:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032240.813666:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835029248 00000100:00100000:1.0:1787032240.813678:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835029248 00000100:00100000:1.0:1787032240.813731:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 111 00000100:00100000:1.0:1787032240.813751:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+54:10508:x1873838835029248:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032240.813774:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032240.813798:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2920 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.813861:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.813873:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2920 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.813897:0:5798:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.813909:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2920 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.813937:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032240.813940:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787032240.813944:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2920 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032240.813951:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774c00, rc 0) 00000100:00100000:1.0:1787032240.814019:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+55:10508:x1873838835029248:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 269us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032240.814026:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 111 00010000:00010000:0.0:1787032240.833333:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787032241.282200:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032241.282211:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032241.282269:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787032241.282280:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787032241.282427:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff537b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857063168:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787032241.282543:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032241.292248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032241.292549:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835029376 00000100:00100000:1.0:1787032241.292559:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835029376 00000100:00100000:1.0:1787032241.292632:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 112 00000100:00100000:1.0:1787032241.292642:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+56:10509:x1873838835029376:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787032241.292674:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787032241.292774:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+56:10509:x1873838835029376:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 133us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032241.292783:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 112 00000100:00100000:0.0:1787032241.292867:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff537b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857063168:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1787032241.293102:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032241.302517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032241.302731:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835029504 00000100:00100000:1.0:1787032241.302740:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835029504 00000100:00100000:1.0:1787032241.302796:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 113 00000100:00100000:1.0:1787032241.303195:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+55:10509:x1873838835029504:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787032241.303275:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303292:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303319:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303367:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303375:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303382:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303406:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303480:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303488:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032241.303527:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787032241.303531:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032241.303542:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303553:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303624:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303642:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303648:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032241.303652:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303660:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303673:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:1.0:1787032241.303677:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032241.303682:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303688:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea073 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303699:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303705:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303711:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.303715:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032241.303718:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304262:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304271:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff99cdce1ff700) 00010000:00010000:1.0:1787032241.304273:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032241.304276:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304282:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea07a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304299:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304305:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304310:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304315:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032241.304317:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304323:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304330:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032241.304332:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032241.304335:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.304353:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032241.304448:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+55:10509:x1873838835029504:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 Request processed in 1640us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032241.304457:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 113 00000100:00100000:1.0:1787032241.307712:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032241.307760:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835029760 00000100:00100000:0.0:1787032241.307771:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835029760 00000100:00100000:0.0:1787032241.307889:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 114 00000100:00100000:0.0:1787032241.307901:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+55:10509:x1873838835029760:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032241.307922:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032241.307942:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea088 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2927 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308084:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308101:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308125:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032241.308139:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787032241.308246:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308254:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308260:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308297:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032241.308302:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308309:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308324:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:0.0:1787032241.308327:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787032241.308333:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308339:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea08f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308383:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea088 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2927 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308395:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:0.0:1787032241.308397:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787032241.308400:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea088 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2927 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.308408:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536000, rc 0) 00000100:00100000:0.0:1787032241.308483:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+56:10509:x1873838835029760:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 584us (781us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787032241.308492:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 114 00000100:00100000:3.0:1787032241.315221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032241.315541:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835029888 00000100:00100000:0.0:1787032241.315566:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835029888 00000100:00100000:0.0:1787032241.315624:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 115 00000100:00100000:0.0:1787032241.315634:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+56:10509:x1873838835029888:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787032241.315670:0:5799:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787032241.315776:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+56:10509:x1873838835029888:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 143us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032241.315784:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 115 00000100:00100000:1.0:1787032241.322594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.323796:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835030144 00000100:00100000:3.0:1787032241.323811:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835030144 00000100:00100000:3.0:1787032241.323889:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 116 00000100:00100000:3.0:1787032241.323915:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+56:10509:x1873838835030144:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.323938:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032241.323942:0:7755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787032241.323981:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea02d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b290b expref: 56 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.324003:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032241.324008:0:7755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032241.324024:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea09d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b292e expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787032241.324520:0:7755:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787032241.324942:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.324960:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.324981:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.325057:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea09d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b292e expref: 58 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.325110:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b292e expref: 57 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.325120:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a900) 00010000:00010000:3.0:1787032241.325123:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032241.325139:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419200, rc 0) 00000100:00100000:3.0:1787032241.325233:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+57:10509:x1873838835030144:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 1319us (2648us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787032241.325243:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 116 00000100:00100000:1.0:1787032241.334618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.334811:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835030400 00000100:00100000:3.0:1787032241.334822:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835030400 00000100:00100000:3.0:1787032241.334931:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 117 00000100:00100000:3.0:1787032241.334942:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+57:10509:x1873838835030400:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.335013:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032241.335040:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b292e expref: 57 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335058:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a900) 00010000:00010000:3.0:1787032241.335124:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032241.335147:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335161:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335172:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335226:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335234:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335241:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335342:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335350:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335357:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335363:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032241.335367:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335374:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335383:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032241.335386:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032241.335389:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335395:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335403:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335420:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335425:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335436:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032241.335439:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335445:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335454:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x539ad067 (ffff99cdcba3ae00) 00010000:00010000:3.0:1787032241.335456:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032241.335459:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.335464:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x539ad067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.335538:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+56:10509:x1873838835030400:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 598us (929us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787032241.335545:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 117 00000100:00100000:1.0:1787032241.340345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.340478:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835030528 00000100:00100000:3.0:1787032241.340488:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835030528 00000100:00100000:3.0:1787032241.340542:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 118 00000100:00100000:3.0:1787032241.340552:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+56:10509:x1873838835030528:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.340809:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032241.340835:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2935 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.340875:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.340916:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.340928:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.341137:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 58 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.341157:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 57 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.341166:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:3.0:1787032241.341169:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787032241.341173:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418200, rc 0) 00000100:00100000:3.0:1787032241.341239:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+57:10509:x1873838835030528:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 687us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.341247:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 118 00000100:00100000:1.0:1787032241.345360:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032241.346182:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835030784 00000100:00100000:0.0:1787032241.346192:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835030784 00000100:00100000:0.0:1787032241.346251:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 119 00000100:00100000:0.0:1787032241.346262:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+57:10509:x1873838835030784:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787032241.346352:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.346369:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.346380:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787032241.346637:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1787032241.346646:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396192577682ns, next at 397192575835ns, rc = 0 00000004:00010000:0.0:1787032241.346944:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003fe0f617 reply state 000000006ff79dae transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032241.346953:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787032241.349010:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+59:10509:x1873838835030784:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 2738us (3650us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787032241.349023:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 119 00000100:00100000:1.0:1787032241.353148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.353232:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835030912 00000100:00100000:3.0:1787032241.353245:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835030912 00000100:00100000:3.0:1787032241.353331:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 120 00000100:00100000:3.0:1787032241.353343:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+59:10509:x1873838835030912:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.353377:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032241.353406:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b293c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.353488:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.353520:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.353543:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:3.0:1787032241.353547:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787032241.353551:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419200, rc 0) 00000100:00100000:3.0:1787032241.353618:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+60:10509:x1873838835030912:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 277us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.353625:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 120 00000100:00100000:1.0:1787032241.357376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.357588:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835031040 00000100:00100000:3.0:1787032241.357597:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835031040 00000100:00100000:3.0:1787032241.357655:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 38 00000100:00100000:3.0:1787032241.357675:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835031040:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787032241.357981:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835031040:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 316us (615us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787032241.357989:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 38 00010000:00010000:0.0:1787032241.359249:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.359264:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.359296:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.359303:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032241.359307:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.359314:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.359330:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:0.0:1787032241.359333:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787032241.359338:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.359344:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea0ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.362520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032241.362917:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835031296 00000100:00100000:0.0:1787032241.362928:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835031296 00000100:00100000:0.0:1787032241.363018:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 30 00000100:00100000:0.0:1787032241.363028:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+59:10509:x1873838835031296:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787032241.363298:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+60:10509:x1873838835031296:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 272us (788us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787032241.363307:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 30 00000100:00100000:2.0:1787032241.366324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.366518:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835031552 00000100:00100000:3.0:1787032241.366527:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835031552 00000100:00100000:3.0:1787032241.366582:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 121 00000100:00100000:3.0:1787032241.366592:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+60:10509:x1873838835031552:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787032241.366788:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+60:10509:x1873838835031552:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 196us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.366796:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 121 00000100:00100000:1.0:1787032241.370240:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.370487:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835031680 00000100:00100000:3.0:1787032241.370509:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835031680 00000100:00100000:3.0:1787032241.370574:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 122 00000100:00100000:3.0:1787032241.370584:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+60:10509:x1873838835031680:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.370605:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032241.370627:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2943 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.370711:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.370726:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.370737:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032241.370773:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032241.370792:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.370817:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea0dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2943 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.370836:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2943 expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.370845:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:3.0:1787032241.370848:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787032241.370851:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418000, rc 0) 00000100:00100000:3.0:1787032241.370915:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+61:10509:x1873838835031680:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 332us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.370928:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 122 00000100:00100000:1.0:1787032241.379057:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.379188:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835031808 00000100:00100000:3.0:1787032241.379198:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835031808 00000100:00100000:3.0:1787032241.379256:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:3.0:1787032241.379266:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+9:2355:x1873838835031808:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.379294:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032241.379315:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b294a expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787032241.379342:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a83f2b0, blocks: 0x1 00010000:00010000:3.0:1787032241.379360:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787032241.379364:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032241.379374:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 10 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.379391:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 10 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.379404:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418e00, rc 0) 00000100:00100000:3.0:1787032241.379465:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+10:2355:x1873838835031808:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 201us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.379472:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:2.0:1787032241.382757:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.382851:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835032064 00000100:00100000:3.0:1787032241.382860:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835032064 00000100:00100000:3.0:1787032241.382913:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 123 00000100:00100000:3.0:1787032241.382922:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+61:10509:x1873838835032064:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787032241.383057:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+61:10509:x1873838835032064:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.383065:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 123 00000100:00100000:0.0:1787032241.386930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.387026:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835032192 00000100:00100000:3.0:1787032241.387038:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835032192 00000100:00100000:3.0:1787032241.387127:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:3.0:1787032241.387137:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+10:10509:x1873838835032192:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.387155:0:6895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032241.387175:0:6895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2951 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.387208:0:6895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 11 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.387217:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032241.387222:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032241.387228:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 11 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.387262:0:6895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 11 pid: 6586 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.387276:0:6895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 11 pid: 6586 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.387368:0:6895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857063296:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032241.387535:0:6895:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42240 going to sleep for 11 seconds 00000100:00100000:1.0:1787032241.393572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032241.393679:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835032320 00000100:00100000:2.0:1787032241.393688:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835032320 00010000:00010000:2.0:1787032241.393741:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 12 pid: 6586 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.393785:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 56 00000100:00100000:2.0:1787032241.393809:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+12:2355:x1873838835032320:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032241.393824:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032241.393847:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 12 pid: 6586 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.393860:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 12 pid: 6586 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.393885:0:11533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032241.393890:0:11533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032241.393899:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 12 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.393910:0:11533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 12 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.393947:0:11533:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 12 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.393964:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef002a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11533:1873838857063424:192.168.201.48@tcp:105: 00000100:00100000:2.0:1787032241.394064:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded0cc9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787032241.395621:0:6895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024c56716/0xcd047797ef1ea0ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b294a expref: 12 pid: 6586 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.395641:0:6895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857063296:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032241.395676:0:6895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 11 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.395690:0:6895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418a00, rc 0) 00000100:00100000:3.0:1787032241.396142:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+11:10509:x1873838835032192:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 9004us (9222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.396152:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:3.0:1787032241.403206:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef002a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11533:1873838857063424:192.168.201.48@tcp:105: 00010000:00010000:3.0:1787032241.403232:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032241.403276:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+10:2355:x1873838835032320:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 9469us (9724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.403297:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 56 00000100:00100000:1.0:1787032241.408608:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.408795:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835032448 00000100:00100000:3.0:1787032241.408805:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835032448 00002000:00100000:3.0:1787032241.408858:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99cdef892a00 x1873838835032448/t0(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:102/0 lens 504/0 e 0 to 0 dl 1787032252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787032241.408870:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdef892a00 with x1873838835032448 ext(0->12) 00002000:00010000:3.0:1787032241.408876:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdef892a00 00000100:00100000:3.0:1787032241.408910:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:3.0:1787032241.408921:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+10:2354:x1873838835032448:12345-192.168.201.48@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787032241.411096:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+12:2354:x1873838835032448:12345-192.168.201.48@tcp:4:lhsmtool_posix.0 Request processed in 2168us (2489us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787032241.411110:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 2 00002000:00100000:3.0:1787032241.411120:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99cdef892a00 x1873838835032448/t4294967308(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:102/0 lens 504/448 e 0 to 0 dl 1787032252 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787032241.411131:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdef892a00 with x1873838835032448 ext(0->12) 00002000:00010000:3.0:1787032241.411135:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdef892a00 00000100:00100000:2.0:1787032241.421164:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.421257:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835032576 00000100:00100000:3.0:1787032241.421267:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835032576 00000100:00100000:3.0:1787032241.421338:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 124 00000100:00100000:3.0:1787032241.421349:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+61:10509:x1873838835032576:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787032241.500831:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+61:10509:x1873838835032576:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 Request processed in 79454us (79647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032241.500848:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 124 00000001:00080000:1.0:1787032241.502238:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787032241.502255:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1787032241.502291:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787032241.502351:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cdffe5bd80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787032241.502358:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdc6109700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cdc5422b40 00000020:00080000:1.0:1787032241.502361:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdc6109100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdfb039800 00000020:00080000:1.0:1787032241.502393:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cdc9d42a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787032241.502396:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdd891b700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cdc9d42540 00000020:00080000:1.0:1787032241.502399:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdd891b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdcbb53800 00000004:00080000:1.0:1787032241.502455:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787032241.502485:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1787032241.502757:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787032241.502776:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857063552:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787032241.502857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032241.502924:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857063552 00000100:00100000:3.0:1787032241.502932:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857063552 00000100:00100000:3.0:1787032241.502990:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787032241.503000:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1873838857063552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787032241.503031:0:6586:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1787032241.503065:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a83f2af, atime: 0x6a83f2af, ctime: 0x6a83f2af, blocks: 0x1 00010000:00010000:3.0:1787032241.503101:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.503118:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787032241.503122:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032241.503137:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.503153:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.503162:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.503169:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.503187:0:6586:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787032241.503949:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3305:x1873838857063552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 948us (1088us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787032241.503958:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1787032241.504018:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cdff5cb100/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787032241.504025:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857063552:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1787032241.504432:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1787032241.504447:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032241.504454:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.504465:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032241.504470:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.504480:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.504499:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.504507:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024c56716/0xcd047797ef1ea0f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.504525:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032241.504527:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032241.504529:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032241.504910:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032241.504924:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857063680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787032241.504980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032241.505019:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787032241.505028:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857063808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787032241.505053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032241.505103:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857063680 00000100:00100000:2.0:1787032241.505110:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857063680 00000100:00100000:2.0:1787032241.505154:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857063808 00000100:00100000:2.0:1787032241.505158:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857063808 00000100:00100000:2.0:1787032241.505176:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787032241.505183:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1873838857063680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787032241.505209:0:6895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787032241.505232:0:6895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.505251:0:6895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.505260:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787032241.505264:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787032241.505269:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.505295:0:6895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 11 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.505310:0:6895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 11 pid: 6586 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.505330:0:6895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4981f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857063936:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032241.505391:0:6895:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5554b40 going to sleep for 11 seconds 00000100:00080000:2.0:1787032241.505420:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032241.506158:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032241.506172:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3303:x1873838857063808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787032241.506353:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787032241.506357:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787032240 00002000:00010000:2.0:1787032241.506359:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787032241.506361:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787032240 -> 1787032240 00002000:00010000:2.0:1787032241.506363:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787032241.506432:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3303:x1873838857063808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 263us (1377us total) trans 4294967309 rc 0/0 00000004:00080000:3.0:1787032241.510501:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cde4983b80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787032241.510521:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857063808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787032241.513964:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032241.514128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032241.514728:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835032704 00000100:00100000:1.0:1787032241.514741:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835032704 00000100:00100000:1.0:1787032241.514786:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:1.0:1787032241.514796:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+12:2355:x1873838835032704:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787032241.517563:0:6895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4981f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857063936:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032241.517594:0:6895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.518548:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032241.518717:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835032832 00000100:00100000:2.0:1787032241.518725:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835032832 00010000:00010000:2.0:1787032241.518766:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 13 pid: 6586 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.518809:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 57 00000100:00100000:2.0:1787032241.518820:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+13:2354:x1873838835032832:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032241.518835:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032241.518842:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 13 pid: 6586 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.518872:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 13 pid: 6586 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.518896:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066a28fce/0xcd047797ef1e9eba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b28b0 expref: 13 pid: 6586 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.518912:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787032241.518917:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787032241.518922:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.518932:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.518959:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032241.519020:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+12:2354:x1873838835032832:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 201us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032241.519028:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 57 00010000:00010000:2.0:1787032241.519165:0:6895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519174:0:6895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519185:0:6895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519200:0:6895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519218:0:6895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787032241.519848:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3304:x1873838857063680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14663us (14865us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787032241.519859:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1787032241.519887:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032241.519893:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519903:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032241.519908:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519918:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519935:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519944:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002cea2b9/0xcd047797ef1ea0ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.519979:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032241.519987:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032241.519989:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787032241.520030:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cdef002a00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787032241.520038:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857063680:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1787032241.588727:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787032241.588747:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1787032241.588752:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1787032241.588757:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787032241.588763:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1787032241.588855:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835032704:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 Request processed in 74055us (74724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032241.588883:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:3.0:1787032241.591564:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032241.591693:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835033088 00000100:00100000:1.0:1787032241.591702:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835033088 00000100:00100000:1.0:1787032241.591762:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 125 00000100:00100000:1.0:1787032241.591772:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:10509:x1873838835033088:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787032241.591828:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032241.591857:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea0e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2943 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.591878:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:1.0:1787032241.591884:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032241.591915:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.591929:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.591939:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032241.592255:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b556b52a reply state 000000000156024f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032241.592265:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787032241.592371:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+16:10509:x1873838835033088:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 600us (816us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787032241.592379:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 125 00010000:00010000:3.0:1787032241.601308:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.601328:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.601337:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.601344:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032241.601349:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.601356:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.601375:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:3.0:1787032241.601378:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032241.601383:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.601389:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea106 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032241.601470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032241.601564:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835033216 00000100:00100000:2.0:1787032241.601576:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835033216 00000100:00100000:2.0:1787032241.601640:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:2.0:1787032241.601650:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2354:x1873838835033216:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787032241.601890:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787032241.601894:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787032240 -> 1787032240 00002000:00010000:2.0:1787032241.601896:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787032239 00002000:00010000:2.0:1787032241.601899:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787032240 -> 1787032240 00002000:00010000:2.0:1787032241.601901:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787032241.601975:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835033216:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 317us (500us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787032241.601984:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:2.0:1787032241.619508:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032241.619617:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835033472 00000100:00100000:1.0:1787032241.619640:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835033472 00000100:00100000:1.0:1787032241.619707:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 126 00000100:00100000:1.0:1787032241.619717:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+15:10509:x1873838835033472:12345-192.168.201.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787032241.619783:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.619799:0:7755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 15 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.619808:0:7755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.619843:0:7755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 15 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.619856:0:7755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 15 pid: 7755 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032241.619872:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff62e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857064064:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032241.619975:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032241.621795:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff62e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857064064:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032241.621822:0:7755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.624748:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032241.624863:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835033600 00000100:00100000:1.0:1787032241.624874:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835033600 00010000:00010000:1.0:1787032241.624920:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 16 pid: 7755 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032241.624991:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 58 00000100:00100000:1.0:1787032241.625002:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+16:2354:x1873838835033600:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032241.625018:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032241.625026:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 16 pid: 7755 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.625039:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 16 pid: 7755 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.625063:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418200/0xcd047797ef1ea0c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2935 expref: 16 pid: 7755 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.625120:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:1.0:1787032241.625126:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.625135:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.625143:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.625178:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032241.625227:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:2354:x1873838835033600:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 227us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032241.625233:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 58 00010000:00010000:3.0:1787032241.625296:0:7755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.625304:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.625335:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.625352:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.625359:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.625365:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032241.625369:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.625376:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.625385:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:3.0:1787032241.625388:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787032241.625392:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.625398:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea10d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.625457:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+14:10509:x1873838835033472:12345-192.168.201.48@tcp:55:lhsmtool_posix.0 Request processed in 5741us (5961us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787032241.625466:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 126 00000100:00100000:2.0:1787032241.632910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.632999:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835033728 00000100:00100000:3.0:1787032241.633009:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835033728 00000100:00100000:3.0:1787032241.633100:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:3.0:1787032241.633110:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835033728:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.633154:0:6895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.633187:0:6895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 7 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.633196:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032241.633201:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787032241.633206:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.633243:0:6895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 7 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.633257:0:6895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 7 pid: 6895 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.633273:0:6895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857064192:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032241.633348:0:6895:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42480 going to sleep for 11 seconds 00000100:00100000:0.0:1787032241.636515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032241.636660:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835033856 00000100:00100000:2.0:1787032241.636681:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835033856 00010000:00010000:2.0:1787032241.636721:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 8 pid: 6895 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.636790:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 59 00000100:00100000:2.0:1787032241.636800:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2355:x1873838835033856:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032241.636816:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032241.636840:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 8 pid: 6895 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.636855:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 8 pid: 6895 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.636880:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787032241.636885:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787032241.636890:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.636901:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.636923:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032241.636988:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2355:x1873838835033856:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 189us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032241.636996:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 59 00010000:00010000:3.0:1787032241.637195:0:6895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea0f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2951 expref: 7 pid: 6895 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.637211:0:6895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857064192:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032241.637229:0:6895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637239:0:6895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637253:0:6895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637285:0:6895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637293:0:6895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637306:0:6895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637313:0:6895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032241.637317:0:6895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637327:0:6895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637338:0:6895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.637345:0:6895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea114 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.637395:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835033728:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 Request processed in 4288us (4497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.637404:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:1.0:1787032241.643017:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.643184:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835034112 00000100:00100000:3.0:1787032241.643194:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835034112 00000100:00100000:3.0:1787032241.643250:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 127 00000100:00100000:3.0:1787032241.643260:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:10509:x1873838835034112:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787032241.643483:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.643505:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.643517:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.643804:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.643816:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.643825:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.643861:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.643888:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 15 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.643903:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857064320:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032241.645425:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42480 going to sleep for 11 seconds 00000100:00100000:1.0:1787032241.653842:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032241.653984:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835034240 00000100:00100000:2.0:1787032241.653993:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835034240 00010000:00010000:2.0:1787032241.654031:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 16 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.654112:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:2.0:1787032241.654122:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+16:2355:x1873838835034240:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032241.654139:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032241.654146:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 16 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.654158:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 16 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.654181:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:2.0:1787032241.654186:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.654195:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.654203:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.654221:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032241.654267:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+16:2355:x1873838835034240:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 146us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032241.654287:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 60 00010000:00010000:3.0:1787032241.654460:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea0d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b293c expref: 15 pid: 5797 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.654474:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857064320:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032241.654496:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.654504:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.654510:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787032241.654714:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787032241.654853:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787032241.654902:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787032241.655002:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5798:1873838857064448:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787032241.655050:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032241.655258:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42600 going to sleep for 11 seconds 00000100:00100000:2.0:1787032241.655450:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857064448 00000100:00100000:2.0:1787032241.655456:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857064448 00000100:00100000:2.0:1787032241.655504:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787032241.655513:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1873838857064448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787032241.655612:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1873838857064448:12345-0@lo:1000:mdt00_001.0 Request processed in 100us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032241.655620:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787032241.655704:0:5798:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787032241.655711:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cdff534e00, transno 4294967303 00000004:00080000:1.0:1787032241.655729:0:5798:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1787032241.655753:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cde4983b80, transno 4294967309 00000100:00100000:1.0:1787032241.655762:0:5798:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff99cdef002a00 x1873838857063680/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787032257 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032241.655773:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5798:1873838857064448:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787032241.656310:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787032241.656388:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5798:1873838857064576:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787032241.656436:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032241.656460:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032241.656994:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857064576 00000100:00100000:2.0:1787032241.657000:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857064576 00000100:00100000:2.0:1787032241.657031:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787032241.657039:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1873838857064576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787032241.657227:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5798:x1873838857064576:12345-0@lo:1000:mdt00_001.0 Request processed in 188us (790us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787032241.657234:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787032241.657805:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5798:1873838857064576:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787032241.657847:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657857:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657864:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657870:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032241.657874:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657882:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657912:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdcba3a000) 00010000:00010000:1.0:1787032241.657915:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787032241.657920:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657926:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418e00/0xcd047797ef1ea122 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657958:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657974:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657980:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657985:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032241.657988:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.657993:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.658001:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032241.658003:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787032241.658012:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2920 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.658023:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2920 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.658040:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2920 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032241.658095:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2920 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032241.658108:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857064704:192.168.201.48@tcp:105: 00000100:00100000:1.0:1787032241.658171:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5422b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032241.660400:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.660491:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857064704:192.168.201.48@tcp:105: 00010000:00010000:3.0:1787032241.660517:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660542:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea065 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660574:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660587:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660599:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660610:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660616:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660622:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660628:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032241.660632:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660640:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660650:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032241.660653:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032241.660656:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660679:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea129 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660690:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660697:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660702:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660706:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032241.660709:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660714:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660722:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032241.660724:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787032241.660727:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.660732:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea11b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032241.660980:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+18:10509:x1873838835034112:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 17720us (17972us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787032241.660989:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 127 00000020:00080000:3.0:1787032241.660999:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787032241.661332:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787032241.661337:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787032241.661841:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787032241.661851:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787032241.666209:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835034368 00000100:00100000:0.0:1787032241.666226:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835034368 00000100:00100000:0.0:1787032241.666299:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 31 00000100:00100000:0.0:1787032241.666309:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+18:10508:x1873838835034368:12345-192.168.201.48@tcp:49:lfs.0 00000100:00100000:0.0:1787032241.666461:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+18:10508:x1873838835034368:12345-192.168.201.48@tcp:49:lfs.0 Request processed in 152us (6070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032241.666469:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 31 00000100:00100000:1.0:1787032241.666751:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032241.668311:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835034624 00000100:00100000:3.0:1787032241.668326:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835034624 00000100:00100000:3.0:1787032241.668374:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00100000:3.0:1787032241.668383:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+18:10509:x1873838835034624:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787032241.671255:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787032241.671374:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787032241.671449:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032241.672382:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835034880 00000100:00100000:1.0:1787032241.672394:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835034880 00000100:00100000:1.0:1787032241.672455:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 128 00000100:00100000:1.0:1787032241.672465:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+21:10508:x1873838835034880:12345-192.168.201.48@tcp:58:lfs.0 00010000:00010000:2.0:1787032241.673803:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.673825:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.673837:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.673847:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.673853:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.673859:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.673885:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787032241.673998:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032241.674005:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.674012:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032241.674017:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.674025:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.674033:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+21:10509:x1873838835034624:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 5649us (7280us total) trans 4294967408 rc 0/0 00010000:00010000:3.0:1787032241.674038:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99cdc3864700) 00010000:00010000:3.0:1787032241.674041:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1787032241.674042:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 32 00010000:00010000:3.0:1787032241.674045:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787032241.674048:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787032241.674051:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea130 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.674086:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032241.674088:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032241.674090:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787032241.674426:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787032241.674470:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:10508:x1873838835034880:12345-192.168.201.48@tcp:58:lfs.0 Request processed in 2006us (3026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032241.674478:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 128 00000100:00100000:2.0:1787032241.717447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032241.718399:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835035008 00000100:00100000:0.0:1787032241.718411:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835035008 00000100:00100000:0.0:1787032241.718483:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 129 00000100:00100000:0.0:1787032241.718495:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+20:10511:x1873838835035008:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032241.718521:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032241.718543:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea137 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2958 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.718610:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.718624:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.718634:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.718648:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.718671:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.718678:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.718997:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.719362:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.719375:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.719467:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032241.719480:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 21 pid: 5799 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032241.719494:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857064832:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032241.719638:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032241.725793:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032241.726035:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835035264 00000100:00100000:1.0:1787032241.726045:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835035264 00000100:00100000:1.0:1787032241.726128:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:1.0:1787032241.726138:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+22:5569:x1873838835035264:12345-192.168.201.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787032241.726421:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+23:5569:x1873838835035264:12345-192.168.201.48@tcp:35:ldlm_bl.0 Request processed in 283us (636us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787032241.726428:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:2.0:1787032241.727885:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857064832:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032241.727915:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032241.729462:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032241.729647:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835035392 00000100:00100000:2.0:1787032241.729656:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835035392 00010000:00010000:2.0:1787032241.729698:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 23 pid: 5799 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032241.729739:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00100000:2.0:1787032241.729749:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+23:2354:x1873838835035392:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032241.729766:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032241.729774:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 23 pid: 5799 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.729786:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 23 pid: 5799 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.729823:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea057 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2919 expref: 23 pid: 5799 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.729841:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:2.0:1787032241.729859:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.729868:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.729876:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032241.729910:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032241.729980:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+22:2354:x1873838835035392:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 231us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032241.729987:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 61 00010000:00010000:3.0:1787032241.730164:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730183:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032241.730222:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787032241.730226:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032241.730243:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730256:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730266:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730272:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730279:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730286:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032241.730290:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730297:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730307:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032241.730310:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032241.730314:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730330:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea13e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730343:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730350:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730355:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730360:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032241.730363:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730369:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730377:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99cdc4f0a300) 00010000:00010000:3.0:1787032241.730379:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032241.730382:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730387:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730433:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea137 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2958 expref: 22 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730447:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2958 expref: 21 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032241.730461:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032241.730463:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032241.730466:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536800, rc 0) 00000100:00100000:3.0:1787032241.730494:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+21:10511:x1873838835035008:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 12001us (13058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032241.730501:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 129 00010000:00010000:2.0:1787032241.862775:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787032241.982029:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787032241.982057:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1787032241.982108:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1787032241.982115:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:3.0:1787032242.563487:0:11920:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787032242.563499:0:11920:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787032242.563562:0:11920:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787032242.563572:0:11920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787032242.689292:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787032242.689302:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787032242.689350:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787032242.689357:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787032242.689498:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857064960:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787032242.689605:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc348aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032242.697323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032242.697598:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835035520 00000100:00100000:3.0:1787032242.697608:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835035520 00000100:00100000:3.0:1787032242.697869:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 130 00000100:00100000:3.0:1787032242.697881:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+22:10523:x1873838835035520:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787032242.697916:0:7755:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787032242.698030:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+22:10523:x1873838835035520:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 151us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032242.698037:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 130 00000100:00100000:0.0:1787032242.703724:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032242.703865:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835035776 00000100:00100000:3.0:1787032242.703874:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835035776 00000100:00100000:3.0:1787032242.703935:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 131 00000100:00100000:3.0:1787032242.703953:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+22:10523:x1873838835035776:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032242.703977:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032242.703998:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea153 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b295f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.704138:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea15a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.704154:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.704167:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032242.704180:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787032242.704308:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea153 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b295f expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.704326:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea15a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b295f expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.704335:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032242.704338:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032242.704342:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419c00, rc 0) 00000100:00100000:3.0:1787032242.706062:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+24:10523:x1873838835035776:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 2110us (2339us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787032242.706100:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 131 00000100:00100000:1.0:1787032242.710134:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857064960:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787032242.716921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032242.717028:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032242.717116:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835036160 00000100:00100000:1.0:1787032242.717126:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835036160 00000100:00100000:1.0:1787032242.717189:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:1.0:1787032242.717199:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+23:2356:x1873838835036160:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032242.717214:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032242.717240:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419c00/0xcd047797ef1ea15a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b295f expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032242.717258:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032242.717263:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032242.717315:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+22:2356:x1873838835036160:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 117us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032242.717338:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:3.0:1787032242.722261:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835036032 00000100:00100000:3.0:1787032242.722276:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835036032 00000100:00100000:3.0:1787032242.724354:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 132 00000100:00100000:3.0:1787032242.724371:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+22:10523:x1873838835036032:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787032242.724467:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724495:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724507:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724715:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724724:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724731:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724736:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032242.724740:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724748:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724762:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032242.724765:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787032242.724771:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032242.724778:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea168 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032242.724925:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+23:10523:x1873838835036032:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 558us (8013us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787032242.724940:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 132 00000040:00080000:3.0:1787032242.727751:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787032242.727759:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787032242.728368:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787032242.728377:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787032242.734746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032242.742955:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835036416 00000100:00100000:1.0:1787032242.742977:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835036416 00000100:00100000:0.0:1787032242.744215:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 34 00000100:00100000:0.0:1787032242.744240:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+23:10523:x1873838835036416:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787032242.744490:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+24:10523:x1873838835036416:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 253us (9752us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787032242.744498:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 34 00010000:00010000:3.0:1787032242.881440:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032242.945472:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857065344:0@lo:400:kworker.0 00000100:00100000:0.0:1787032242.945616:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857065216:0@lo:400:kworker.0 00000100:00100000:2.0:1787032242.945719:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857065472:0@lo:400:kworker.0 00000100:00100000:3.0:1787032242.945814:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857065088:0@lo:400:kworker.0 00000100:00100000:0.0:1787032242.950977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032242.951056:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857065728:0@lo:400:kworker.0 00000100:00100000:0.0:1787032242.951115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032242.951188:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857065216 00000100:00100000:0.0:1787032242.951196:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857065216 00000100:00100000:0.0:1787032242.951254:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787032242.951263:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857065216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032242.951328:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857065216:12345-0@lo:400:kworker.0 Request processed in 66us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032242.951335:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787032242.951382:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857065216:0@lo:400:kworker.0 00000100:00100000:0.0:1787032242.951439:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857065728 00000100:00100000:0.0:1787032242.951443:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857065728 00000100:00100000:0.0:1787032242.951475:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787032242.951482:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857065728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032242.953382:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032242.953462:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857065472 00000100:00100000:2.0:1787032242.953469:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857065472 00000100:00100000:2.0:1787032242.953539:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787032242.953548:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857065472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032242.953605:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857065472:12345-0@lo:400:kworker.0 Request processed in 59us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032242.953613:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787032242.953632:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032242.953663:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787032242.953669:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1787032242.953704:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cde4872a00, transno 4294967301 00000004:00080000:2.0:1787032242.953714:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787032242.953723:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cdff5cb100, transno 4294967304 00000100:00100000:2.0:1787032242.953729:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857065472:0@lo:400:kworker.0 00000100:00100000:2.0:1787032242.954018:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857065728:0@lo:400:kworker.0 00000100:00100000:1.0:1787032242.955442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032242.955674:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857065344 00000100:00100000:2.0:1787032242.955681:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857065344 00000100:00100000:2.0:1787032242.955735:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787032242.955745:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857065344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032242.955992:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857065344:12345-0@lo:400:kworker.0 Request processed in 248us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032242.956000:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1787032242.956025:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032242.956181:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857065344:0@lo:400:kworker.0 00000100:00100000:3.0:1787032242.956287:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032242.956332:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857065600:0@lo:400:kworker.0 00000100:00100000:3.0:1787032242.956368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032242.956411:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857065600 00000100:00100000:3.0:1787032242.956415:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857065600 00000100:00100000:3.0:1787032242.956448:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787032242.956454:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857065600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032242.956504:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857065600:12345-0@lo:400:kworker.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032242.956511:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1787032242.956525:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032242.956556:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857065600:0@lo:400:kworker.0 00000100:00100000:1.0:1787032242.956769:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857065088 00000100:00100000:1.0:1787032242.956785:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857065088 00000100:00100000:1.0:1787032242.956823:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787032242.956830:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857065088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032242.956866:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857065088:12345-0@lo:400:kworker.0 Request processed in 37us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032242.956872:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787032242.957232:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857065088:0@lo:400:kworker.0 00000100:00100000:0.0:1787032242.957438:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857065728:12345-0@lo:400:kworker.0 Request processed in 5954us (6320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032242.957447:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787032243.457451:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857065856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032243.457552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032243.457686:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857065856 00000100:00100000:1.0:1787032243.457695:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857065856 00000100:00100000:1.0:1787032243.457747:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787032243.457756:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857065856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032243.457802:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032243.457856:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857065856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032243.457864:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787032243.458220:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857065856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032243.458954:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787032243.458970:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857065984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032243.459036:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032243.460219:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857065984 00000100:00100000:0.0:1787032243.460232:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857065984 00000100:00100000:0.0:1787032243.460313:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787032243.460322:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1873838857065984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032243.460358:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032243.460424:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1873838857065984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032243.460431:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787032243.461103:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032243.461169:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857065984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787032243.905298:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787032244.617196:0:11971:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032244.617205:0:11971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032244.617250:0:11971:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787032244.617255:0:11971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787032244.815723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032244.815884:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835036672 00000100:00100000:3.0:1787032244.815895:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835036672 00000100:00100000:3.0:1787032244.815975:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 133 00000100:00100000:3.0:1787032244.815983:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:10543:x1873838835036672:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032244.816011:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032244.816036:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea16f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2966 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787032244.816115:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787032244.817382:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032244.817401:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032244.817414:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032244.817428:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787032244.817588:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418000/0xcd047797ef1ea16f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2966 expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032244.817607:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2966 expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032244.817615:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032244.817619:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787032244.817622:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419200, rc 0) 00000100:00100000:3.0:1787032244.817694:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+26:10543:x1873838835036672:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1710us (1980us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787032244.818445:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 133 00000100:00100000:1.0:1787032244.823388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032244.823444:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835036800 00000100:00100000:1.0:1787032244.823453:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835036800 00000100:00100000:1.0:1787032244.823524:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 134 00000100:00100000:1.0:1787032244.823534:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+26:10543:x1873838835036800:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:1.0:1787032244.823627:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823644:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823655:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823685:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823693:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823700:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823708:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032244.823712:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823719:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823731:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:1.0:1787032244.823734:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787032244.823738:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032244.823754:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032244.823820:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+26:10543:x1873838835036800:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 287us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032244.823827:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 134 00010000:00010000:3.0:1787032244.929437:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032245.009378:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032245.009478:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835036928 00000100:00100000:2.0:1787032245.009487:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835036928 00000100:00100000:3.0:1787032245.009677:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:3.0:1787032245.009689:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838835036928:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:3.0:1787032245.009709:0:6895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032245.009731:0:6895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea18b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b296d expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787032245.009759:0:6895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a83f2b0, atime: 0x6a83f2af, ctime: 0x6a83f2b0, blocks: 0xb 00010000:00010000:3.0:1787032245.009780:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1787032245.009784:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032245.009794:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea18b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b296d expref: 7 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032245.009814:0:6895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea18b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b296d expref: 7 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032245.009829:0:6895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418000, rc 0) 00000100:00080000:1.0:1787032245.009973:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032245.010111:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:2357:x1873838835036928:12345-192.168.201.48@tcp:101:cat.0 Request processed in 423us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032245.010119:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:1.0:1787032245.015774:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032245.015938:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835037056 00000100:00100000:3.0:1787032245.015949:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835037056 00002000:00100000:3.0:1787032245.016112:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff99cde4870700 x1873838835037056/t0(0) o3->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:106/0 lens 488/0 e 0 to 0 dl 1787032256 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787032245.016141:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cde4870700 with x1873838835037056 ext(0->4095) 00002000:00010000:3.0:1787032245.016147:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cde4870700 00000100:00100000:3.0:1787032245.016182:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:3.0:1787032245.016191:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2357:x1873838835037056:12345-192.168.201.48@tcp:3:cat.0 00000100:00100000:3.0:1787032245.016723:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2357:x1873838835037056:12345-192.168.201.48@tcp:3:cat.0 Request processed in 530us (957us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787032245.016733:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 3 00002000:00100000:3.0:1787032245.016740:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff99cde4870700 x1873838835037056/t0(0) o3->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:106/0 lens 488/4536 e 0 to 0 dl 1787032256 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787032245.016748:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cde4870700 with x1873838835037056 ext(0->4095) 00002000:00010000:3.0:1787032245.016751:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cde4870700 00000100:00100000:0.0:1787032245.900279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032245.900312:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032245.900348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032245.900374:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032245.900404:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032245.900431:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835037696 00000100:00100000:0.0:1787032245.900431:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835037312 00000100:00100000:3.0:1787032245.900442:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835037696 00000100:00100000:0.0:1787032245.900442:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835037312 00000100:00100000:0.0:1787032245.900505:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 139 00000100:00100000:1.0:1787032245.900594:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835037184 00000100:00100000:1.0:1787032245.900599:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835037184 00000100:00100000:1.0:1787032245.900630:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 287 00000100:00100000:1.0:1787032245.900638:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835037184:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032245.900713:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835037184:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 76us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032245.900721:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 287 00000100:00100000:0.0:1787032245.900775:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+26:2357:x1873838835037312:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032245.900810:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+26:2357:x1873838835037312:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 297us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032245.901110:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835037440 00000100:00100000:2.0:1787032245.901115:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835037440 00000100:00100000:2.0:1787032245.901160:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835037568 00000100:00100000:2.0:1787032245.901164:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835037568 00000100:00100000:2.0:1787032245.901185:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 78 00000100:00100000:2.0:1787032245.901192:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838835037440:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032245.901230:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838835037440:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 38us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032245.901236:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 78 00000100:00100000:2.0:1787032245.901250:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 79 00000100:00100000:2.0:1787032245.901255:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2357:x1873838835037568:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032245.901279:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2357:x1873838835037568:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 24us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032245.901301:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 79 00000100:00080000:2.0:1787032245.901319:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032245.901324:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032245.907744:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 140 00000100:00100000:3.0:1787032245.907775:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838835037696:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032245.907857:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2357:x1873838835037696:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 98us (7507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032245.907866:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 140 00000100:00100000:0.0:1787032245.912916:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 139 00010000:00010000:3.0:1787032245.958119:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787032246.599841:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1787032246.599882:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cdcb791780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787032246.599889:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdffa6dd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cdcb791b40 00000020:00080000:1.0:1787032246.599893:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdffa6db00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdcbb53800 00000020:00080000:1.0:1787032246.599906:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1787032246.599921:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787032246.599954:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787032246.600177:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1787032246.611190:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787032246.611209:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1787032246.979876:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032248.001351:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032248.065314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787032248.065356:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857066496:0@lo:400:kworker.0 00000100:00100000:2.0:1787032248.065404:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857066240:0@lo:400:kworker.0 00000100:00100000:1.0:1787032248.065431:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032248.065448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032248.065487:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857066112:0@lo:400:kworker.0 00000100:00100000:2.0:1787032248.065488:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857066752:0@lo:400:kworker.0 00000100:00100000:2.0:1787032248.065530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032248.065536:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032248.065560:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032248.065570:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857066368:0@lo:400:kworker.0 00000100:00100000:1.0:1787032248.065583:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787032248.065592:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857066624:0@lo:400:kworker.0 00000100:00100000:2.0:1787032248.065600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032248.065629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032248.065665:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857066240 00000100:00100000:1.0:1787032248.065672:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857066240 00000100:00100000:1.0:1787032248.065713:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857066368 00000100:00100000:1.0:1787032248.065717:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857066368 00000100:00100000:1.0:1787032248.065743:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857066624 00000100:00100000:1.0:1787032248.065747:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857066624 00000100:00100000:1.0:1787032248.065767:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787032248.065775:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857066240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032248.065833:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857066240:12345-0@lo:400:kworker.0 Request processed in 58us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032248.065840:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787032248.065844:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857066496 00000100:00100000:2.0:1787032248.065862:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857066496 00000100:00100000:1.0:1787032248.065871:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787032248.065883:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857066368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032248.065899:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857066752 00000100:00100000:2.0:1787032248.065903:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857066752 00000100:00100000:1.0:1787032248.065916:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857066368:12345-0@lo:400:kworker.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032248.065923:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787032248.065934:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787032248.065942:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787032248.065947:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857066496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032248.065956:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857066624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032248.066003:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857066496:12345-0@lo:400:kworker.0 Request processed in 60us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032248.066006:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857066624:12345-0@lo:400:kworker.0 Request processed in 53us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032248.066015:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787032248.066027:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787032248.066034:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787032248.066043:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857066752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032248.066103:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857066624:0@lo:400:kworker.0 00000100:00100000:3.0:1787032248.066524:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857066112 00000100:00100000:3.0:1787032248.066529:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857066112 00000100:00100000:2.0:1787032248.066533:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857066752:12345-0@lo:400:kworker.0 Request processed in 490us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032248.066541:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787032248.066575:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032248.066579:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032248.066581:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032248.066599:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857066368:0@lo:400:kworker.0 00000100:00100000:2.0:1787032248.066608:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857066240:0@lo:400:kworker.0 00000100:00100000:2.0:1787032248.066616:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787032248.066621:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cdef002a00, transno 4294967310 00000004:00080000:2.0:1787032248.066632:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787032248.066652:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857066752:0@lo:400:kworker.0 00000100:00100000:3.0:1787032248.067836:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787032248.067863:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857066112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032248.067937:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857066112:12345-0@lo:400:kworker.0 Request processed in 92us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032248.067944:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787032248.068721:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857066496:0@lo:400:kworker.0 00000100:00100000:1.0:1787032248.068736:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857066112:0@lo:400:kworker.0 00000100:00100000:1.0:1787032248.589287:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032248.589310:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857066880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032248.589377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032248.589439:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857066880 00000100:00100000:1.0:1787032248.589447:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857066880 00000100:00100000:1.0:1787032248.589494:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787032248.589503:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857066880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787032248.589539:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032248.589582:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857066880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032248.589590:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787032248.589637:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857066880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032248.589948:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787032248.589959:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857067008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032248.589992:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032248.590054:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857067008 00000100:00100000:1.0:1787032248.590059:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857067008 00000100:00100000:1.0:1787032248.590125:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787032248.590132:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857067008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032248.590153:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032248.590186:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857067008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032248.590193:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787032248.590233:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857067008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787032249.026846:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032250.055685:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032250.357181:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032250.357367:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835037824 00000100:00100000:2.0:1787032250.357377:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835037824 00000100:00100000:2.0:1787032250.357460:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 135 00000100:00100000:2.0:1787032250.357470:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+13:10197:x1873838835037824:12345-192.168.201.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787032250.357568:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+13:10197:x1873838835037824:12345-192.168.201.48@tcp:60:lhsmtool_posix.0 Request processed in 100us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032250.357577:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 135 00000100:00080000:3.0:1787032250.357786:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032250.359965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032250.360123:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835038080 00000100:00100000:2.0:1787032250.360132:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835038080 00000100:00100000:2.0:1787032250.360186:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 35 00000100:00100000:2.0:1787032250.360196:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+13:10197:x1873838835038080:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787032250.360751:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+14:10197:x1873838835038080:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 554us (791us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787032250.360760:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 35 00000100:00100000:1.0:1787032250.737022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032250.737161:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835038208 00000100:00100000:2.0:1787032250.737187:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835038208 00000100:00100000:2.0:1787032250.737273:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 136 00000100:00100000:2.0:1787032250.737283:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:10997:x1873838835038208:12345-192.168.201.48@tcp:101:lsof.0 00010000:00010000:2.0:1787032250.737306:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032250.737328:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea192 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2974 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032250.737392:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032250.737406:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032250.737421:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032250.737650:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787032250.737655:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:3.0:1787032250.737885:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1787032250.737970:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032250.738002:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032250.738020:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032250.738028:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:2.0:1787032250.738032:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032250.738035:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032250.738195:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:10997:x1873838835038208:12345-192.168.201.48@tcp:101:lsof.0 Request processed in 913us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032250.738204:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 136 00000040:00080000:0.0:1787032250.948002:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032250.948018:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032250.949020:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1787032250.949029:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787032251.013200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032251.013328:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835038464 00000100:00100000:2.0:1787032251.013338:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835038464 00000100:00100000:2.0:1787032251.013407:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 144 00000100:00100000:2.0:1787032251.013419:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:2355:x1873838835038464:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032251.013772:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:2355:x1873838835038464:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 354us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032251.013780:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 144 00000100:00100000:1.0:1787032251.016184:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032251.017583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032251.017625:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032251.017683:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835038336 00000100:00100000:2.0:1787032251.017693:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835038336 00000100:00100000:2.0:1787032251.017754:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 289 00000100:00100000:2.0:1787032251.017763:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838835038336:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032251.017849:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838835038336:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032251.017857:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 289 00000100:00100000:1.0:1787032251.020746:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032251.020831:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835038848 00000100:00100000:3.0:1787032251.020841:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835038848 00000100:00100000:3.0:1787032251.020903:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 145 00000100:00100000:3.0:1787032251.020914:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2355:x1873838835038848:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032251.020992:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2355:x1873838835038848:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032251.020999:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 145 00000100:00100000:0.0:1787032251.022212:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835038720 00000100:00100000:0.0:1787032251.022222:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835038720 00000100:00100000:0.0:1787032251.022294:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835038592 00000100:00100000:0.0:1787032251.022298:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835038592 00000100:00100000:0.0:1787032251.022324:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 82 00000100:00100000:0.0:1787032251.022332:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835038720:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032251.022631:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 83 00000100:00100000:1.0:1787032251.022642:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838835038592:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032251.022683:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2355:x1873838835038592:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 45us (5058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032251.022690:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 83 00000100:00080000:3.0:1787032251.022772:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787032251.022778:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032251.023304:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835038720:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 970us (7127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032251.023313:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 82 00010000:00010000:1.0:1787032251.073365:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787032251.681569:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1787032251.681592:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787032251.681608:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787032251.681616:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787032252.098916:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032253.121300:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032253.187174:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857067520:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187254:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032253.187308:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787032253.187315:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857067136:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187342:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032253.187361:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857067648:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032253.187432:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857067264:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032253.187473:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857067776:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032253.187509:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787032253.187515:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857067392:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032253.187563:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857067520 00000100:00100000:0.0:1787032253.187570:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857067520 00000100:00100000:0.0:1787032253.187619:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857067776 00000100:00100000:0.0:1787032253.187622:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857067776 00000100:00100000:0.0:1787032253.187645:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787032253.187654:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857067520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187707:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857067520:12345-0@lo:400:kworker.0 Request processed in 54us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032253.187714:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787032253.187732:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787032253.187737:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857067776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187784:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857067776:12345-0@lo:400:kworker.0 Request processed in 46us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032253.187790:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787032253.187819:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857067648 00000100:00100000:0.0:1787032253.187823:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857067648 00000100:00100000:0.0:1787032253.187856:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857067264 00000100:00100000:0.0:1787032253.187860:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857067264 00000100:00100000:0.0:1787032253.187871:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857067392 00000100:00100000:0.0:1787032253.187874:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857067392 00000100:00100000:0.0:1787032253.187889:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787032253.187902:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857067648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187934:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857067648:12345-0@lo:400:kworker.0 Request processed in 33us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032253.187939:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787032253.187953:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787032253.187959:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857067264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.187984:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857067264:12345-0@lo:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032253.187990:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787032253.188000:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787032253.188006:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857067392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.188029:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857067392:12345-0@lo:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032253.188035:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787032253.188104:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857067392:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.188116:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857067264:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.188124:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857067776:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.188157:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857067648:0@lo:400:kworker.0 00000100:00100000:0.0:1787032253.188167:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857067520:0@lo:400:kworker.0 00000100:00100000:3.0:1787032253.189650:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857067136 00000100:00100000:3.0:1787032253.189661:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857067136 00000100:00100000:3.0:1787032253.189707:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787032253.189716:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857067136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032253.189811:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857067136:12345-0@lo:400:kworker.0 Request processed in 85us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032253.189819:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:3.0:1787032253.189861:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787032253.189867:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787032253.189869:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032253.189920:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857067136:0@lo:400:kworker.0 00000001:02000400:0.0:1787032253.686346:0:12171:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:50:52 (1787032252) 00000100:00100000:1.0:1787032253.697813:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfaf89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857067904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032253.697895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032253.697974:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857067904 00000100:00100000:1.0:1787032253.697982:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857067904 00000100:00100000:1.0:1787032253.698037:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787032253.698046:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857067904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787032253.698112:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032253.698215:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857067904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032253.698223:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787032253.698269:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfaf89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857067904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032253.698962:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857068032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032253.699003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032253.699091:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857068032 00000100:00100000:0.0:1787032253.699096:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857068032 00000100:00100000:0.0:1787032253.699131:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787032253.699146:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857068032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032253.699171:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032253.699222:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857068032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032253.699228:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787032253.699261:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857068032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787032254.146773:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032254.874506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032254.874670:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835039104 00000100:00100000:0.0:1787032254.874681:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835039104 00000100:00100000:0.0:1787032254.874786:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 137 00000100:00100000:0.0:1787032254.874797:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+13:11262:x1873838835039104:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032254.874819:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032254.874839:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea1a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b297b expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.874919:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.874935:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.874949:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.874964:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.874971:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.874997:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875643:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea1b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875657:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875665:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032254.875676:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787032254.875907:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875916:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875922:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875928:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032254.875932:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875939:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875952:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cdc3864100) 00010000:00010000:0.0:1787032254.875954:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032254.875965:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875971:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea1a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875985:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875992:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.875997:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.876003:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032254.876006:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.876011:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.876020:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99cdc4f0ac00) 00010000:00010000:0.0:1787032254.876022:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032254.876025:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.876030:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea1ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787032254.876191:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787032254.877822:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea1a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b297b expref: 16 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.877864:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b297b expref: 15 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.877874:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:0.0:1787032254.877877:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032254.877881:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537c00, rc 0) 00000100:00100000:0.0:1787032254.877970:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+15:11262:x1873838835039104:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 3174us (3472us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787032254.877979:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 137 00000100:00100000:1.0:1787032254.887352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032254.887490:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835039232 00000100:00100000:0.0:1787032254.887500:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835039232 00000100:00100000:0.0:1787032254.887556:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 138 00000100:00100000:0.0:1787032254.887567:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+15:11262:x1873838835039232:12345-192.168.201.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787032254.887681:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+15:11262:x1873838835039232:12345-192.168.201.48@tcp:59:lhsmtool_posix.0 Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032254.887688:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 138 00000100:00100000:3.0:1787032254.893161:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032254.893369:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835039360 00000100:00100000:0.0:1787032254.893381:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835039360 00000100:00100000:0.0:1787032254.893453:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:0.0:1787032254.893463:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+15:2355:x1873838835039360:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032254.893479:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032254.893509:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea1b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b297b expref: 15 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032254.893532:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:0.0:1787032254.893552:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032254.893622:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+14:2355:x1873838835039360:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 159us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032254.893631:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00000040:00080000:0.0:1787032255.041296:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032255.041306:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032255.041342:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1787032255.041348:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787032255.173971:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032256.138970:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032256.139015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032256.139050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032256.139102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032256.139125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032256.139151:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835040000 00000100:00100000:1.0:1787032256.139161:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835040000 00000100:00100000:1.0:1787032256.139219:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835039616 00000100:00100000:1.0:1787032256.139223:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835039616 00000100:00100000:1.0:1787032256.139248:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 149 00000100:00100000:1.0:1787032256.139257:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2356:x1873838835040000:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032256.139671:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835039744 00000100:00100000:0.0:1787032256.139677:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835039744 00000100:00100000:0.0:1787032256.139721:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835039872 00000100:00100000:0.0:1787032256.139724:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835039872 00000100:00100000:0.0:1787032256.139747:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00100000:0.0:1787032256.139754:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2356:x1873838835039744:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032256.139812:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2356:x1873838835039744:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 57us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032256.139820:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00100000:0.0:1787032256.139837:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 87 00000100:00100000:0.0:1787032256.139843:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838835039872:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032256.139871:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2356:x1873838835039872:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 28us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032256.139877:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 87 00000100:00100000:0.0:1787032256.139898:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 150 00000100:00100000:0.0:1787032256.139905:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+14:2356:x1873838835039616:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032256.139932:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+14:2356:x1873838835039616:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 27us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032256.139952:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 150 00000100:00100000:3.0:1787032256.140386:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835039488 00000100:00100000:3.0:1787032256.140393:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835039488 00000100:00100000:3.0:1787032256.140451:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 291 00000100:00100000:3.0:1787032256.140459:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2356:x1873838835039488:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032256.140499:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2356:x1873838835039488:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 42us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032256.140506:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 291 00000100:00100000:1.0:1787032256.140834:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2356:x1873838835040000:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 1576us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032256.140918:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 149 00000100:00080000:1.0:1787032256.140943:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787032256.140947:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787032256.140951:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787032256.193454:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787032256.879709:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1787032256.956453:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032256.957483:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835040128 00000100:00100000:1.0:1787032256.957494:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835040128 00000100:00100000:1.0:1787032256.957585:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 139 00000100:00100000:1.0:1787032256.957597:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+13:11304:x1873838835040128:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032256.957620:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032256.957643:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea1c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2982 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.957720:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.957744:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.957757:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.957773:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.957781:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.957788:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958116:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958394:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958402:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958408:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032256.958412:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958420:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958433:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:1.0:1787032256.958443:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032256.958448:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958455:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea1ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958467:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958473:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958479:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958485:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032256.958488:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958493:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958500:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99cdce1ff800) 00010000:00010000:1.0:1787032256.958503:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032256.958506:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958512:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea1d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958549:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea1c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2982 expref: 14 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958573:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:1.0:1787032256.958576:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032256.958580:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea1c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2982 expref: 14 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.958590:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774200, rc 0) 00000100:00100000:1.0:1787032256.958665:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+13:11304:x1873838835040128:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1070us (2221us total) trans 0 rc 301/301 00000100:00100000:1.0:1787032256.958672:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 139 00000100:00100000:3.0:1787032256.962589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032256.973256:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835040384 00000100:00100000:2.0:1787032256.973341:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835040384 00000100:00100000:3.0:1787032256.973524:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 140 00000100:00100000:3.0:1787032256.973536:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+13:11304:x1873838835040384:12345-192.168.201.48@tcp:36:lfs.0 00010000:00010000:3.0:1787032256.973599:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032256.973632:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1e9b41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27bb expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.973651:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:3.0:1787032256.973656:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032256.973961:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.973977:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 5 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.973986:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.974027:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 5 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.974042:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 5 pid: 5797 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032256.974057:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf486f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857068160:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032256.974387:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc352c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787032256.980408:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf486f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857068160:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032256.980437:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032256.984739:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032256.984885:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835040512 00000100:00100000:3.0:1787032256.984894:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835040512 00010000:00010000:3.0:1787032256.984935:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 6 pid: 5797 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032256.984981:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 62 00000100:00100000:3.0:1787032256.984991:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2355:x1873838835040512:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787032256.985005:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032256.985012:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 6 pid: 5797 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.985024:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 6 pid: 5797 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.985045:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea199 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2974 expref: 6 pid: 5797 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.985059:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:3.0:1787032256.985094:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.985104:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.985112:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032256.985260:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032256.985351:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.985359:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.985383:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.985392:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.985400:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032256.986865:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787032256.986882:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.986902:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.986909:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.986915:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032256.986921:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.986929:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.986942:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdcba3a700) 00010000:00010000:1.0:1787032256.986945:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032256.986949:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032256.986955:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea1d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032256.986973:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005095401a reply state 000000001818de73 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032256.986982:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787032256.987117:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+14:11304:x1873838835040384:12345-192.168.201.48@tcp:36:lfs.0 Request processed in 13578us (24533us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787032256.987248:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2355:x1873838835040512:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 2256us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032256.987258:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 62 00000100:00100000:1.0:1787032256.989232:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 140 00010000:00010000:2.0:1787032256.990994:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032256.991015:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032256.991043:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032256.991049:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032256.991054:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032256.991063:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032256.991208:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99cdce1ffb00) 00010000:00010000:2.0:1787032256.991213:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032256.991219:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032256.991226:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea1df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032257.099005:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032257.099167:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835040640 00000100:00100000:0.0:1787032257.099179:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835040640 00000100:00100000:0.0:1787032257.099242:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 141 00000100:00100000:0.0:1787032257.099253:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+13:11312:x1873838835040640:12345-192.168.201.48@tcp:101:lctl.0 00010000:00010000:0.0:1787032257.099279:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032257.099305:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea1e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2989 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.099376:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea1ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.099389:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.099401:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032257.099462:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787032257.099467:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032257.099495:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.099672:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea1e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2989 expref: 15 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.099702:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea1ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2989 expref: 14 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.099710:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:0.0:1787032257.099713:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787032257.099716:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536a00, rc 0) 00000100:00100000:0.0:1787032257.099817:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+14:11312:x1873838835040640:12345-192.168.201.48@tcp:101:lctl.0 Request processed in 565us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032257.099824:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 141 00000100:00100000:1.0:1787032257.160783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032257.161225:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835040768 00000100:00100000:0.0:1787032257.161234:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835040768 00000100:00100000:0.0:1787032257.161296:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 142 00000100:00100000:0.0:1787032257.161307:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+14:11318:x1873838835040768:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032257.161327:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032257.161357:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea1f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2990 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161421:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161436:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161449:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161473:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161481:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161488:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161789:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161799:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161806:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032257.161839:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787032257.161843:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032257.161865:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161878:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161883:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161890:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161908:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032257.161912:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161921:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161934:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:0.0:1787032257.161937:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032257.161942:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161948:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea1fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161963:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161970:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161976:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161981:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032257.161984:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.161990:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.162010:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99cdc4f0ac00) 00010000:00010000:0.0:1787032257.162012:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032257.162015:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.162022:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.162053:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea1f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2990 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.164296:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2990 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.164313:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032257.164316:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787032257.164319:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537200, rc 0) 00000100:00100000:0.0:1787032257.164411:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+15:11318:x1873838835040768:12345-192.168.201.48@tcp:101:bash.0 Request processed in 3105us (3639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032257.164419:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 142 00000100:00100000:3.0:1787032257.177148:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032257.178439:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835041024 00000100:00100000:2.0:1787032257.178450:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835041024 00000100:00100000:2.0:1787032257.178526:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 143 00000100:00100000:2.0:1787032257.178537:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+15:11318:x1873838835041024:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:2.0:1787032257.178559:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032257.178582:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea210 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2997 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.178735:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.178768:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.178780:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.178795:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.178802:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.178809:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787032257.183227:0:5799:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787032257.185320:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185654:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185668:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185723:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185731:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185738:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185757:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032257.185762:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185770:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185783:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032257.185786:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032257.185791:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185797:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea217 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787032257.185812:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7ebb5db reply state 000000004e19c262 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032257.185821:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787032257.185860:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea210 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185875:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.185883:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864e00) 00010000:00010000:2.0:1787032257.185885:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032257.185887:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7600, rc 0) 00000100:00100000:2.0:1787032257.185961:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+18:11318:x1873838835041024:12345-192.168.201.48@tcp:101:bash.0 Request processed in 7425us (8824us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787032257.185976:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 143 00010000:00010000:1.0:1787032257.187984:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.188004:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.188012:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.188018:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032257.188022:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.188029:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.188045:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc3864f00) 00010000:00010000:1.0:1787032257.188048:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032257.188052:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.188059:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea21e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032257.190775:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032257.196902:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835041152 00000100:00100000:0.0:1787032257.196920:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835041152 00000100:00100000:0.0:1787032257.196999:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:0.0:1787032257.197009:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838835041152:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032257.197029:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032257.197050:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b299e expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787032257.197113:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032257.197147:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1787032257.197152:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032257.197163:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 6 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.197183:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 6 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.197196:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537000, rc 0) 00000100:00100000:0.0:1787032257.197271:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838835041152:12345-192.168.201.48@tcp:101:bash.0 Request processed in 262us (6507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032257.197279:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:3.0:1787032257.200543:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032257.200664:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835041280 00000100:00100000:0.0:1787032257.200674:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835041280 00000100:00100000:0.0:1787032257.200738:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:0.0:1787032257.200748:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:11318:x1873838835041280:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032257.200766:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032257.200782:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29a5 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.200814:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.200840:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032257.200844:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032257.200849:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.200885:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.200899:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 7 pid: 6584 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032257.200913:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb35aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1873838857068288:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032257.204373:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787032257.206756:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb35aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1873838857068288:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032257.206794:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.206820:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537800, rc 0) 00000100:00100000:3.0:1787032257.206840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032257.206870:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:11318:x1873838835041280:12345-192.168.201.48@tcp:101:bash.0 Request processed in 6122us (6337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032257.206879:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:0.0:1787032257.206966:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835041408 00000100:00100000:0.0:1787032257.206973:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835041408 00010000:00010000:0.0:1787032257.207004:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 7 pid: 6584 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032257.207037:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:0.0:1787032257.207044:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835041408:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032257.207058:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032257.207112:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 7 pid: 6584 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.207125:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 7 pid: 6584 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.207164:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea233 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b299e expref: 7 pid: 6584 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.207178:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032257.207183:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032257.207189:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.207197:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.207233:0:5784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032257.207243:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb35a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5784:1873838857068416:192.168.201.48@tcp:105: 00000100:00100000:0.0:1787032257.207285:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032257.209499:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb35a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5784:1873838857068416:192.168.201.48@tcp:105: 00010000:00010000:0.0:1787032257.209539:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032257.209599:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032257.209619:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835041408:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 2573us (2778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032257.209632:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:1.0:1787032257.209716:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835041664 00000100:00100000:1.0:1787032257.209723:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835041664 00000100:00100000:1.0:1787032257.209771:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:1.0:1787032257.209780:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+17:11318:x1873838835041664:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:1.0:1787032257.210145:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+18:11318:x1873838835041664:12345-192.168.201.48@tcp:35:bash.0 Request processed in 365us (546us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787032257.210152:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 36 00010000:00010000:0.0:1787032257.217625:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032257.296879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032257.296997:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835041920 00000100:00100000:1.0:1787032257.297009:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835041920 00000100:00100000:2.0:1787032257.297323:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 144 00000100:00100000:2.0:1787032257.297333:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+18:11328:x1873838835041920:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032257.297357:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032257.297376:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29ac expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032257.297506:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787032257.297647:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea241 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29ac expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.297662:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:2.0:1787032257.297665:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032257.297670:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29ac expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.297710:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7c00, rc 0) 00000100:00100000:2.0:1787032257.297815:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+19:11328:x1873838835041920:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 483us (945us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787032257.297822:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 144 00000100:00100000:2.0:1787032257.303194:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032257.303310:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835042176 00000100:00100000:3.0:1787032257.303320:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835042176 00000100:00100000:3.0:1787032257.303418:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:3.0:1787032257.303428:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+19:11328:x1873838835042176:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032257.304036:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:11328:x1873838835042176:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 607us (850us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787032257.304045:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:3.0:1787032257.388033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032257.388215:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835042304 00000100:00100000:0.0:1787032257.388226:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835042304 00000100:00100000:0.0:1787032257.388302:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 145 00000100:00100000:0.0:1787032257.388313:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+20:11334:x1873838835042304:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032257.388338:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032257.388361:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea24f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29b3 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.388433:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.388448:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.388460:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032257.388520:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787032257.388525:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032257.388547:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.388791:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea24f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29b3 expref: 22 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.388810:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29b3 expref: 21 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.388819:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032257.388822:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787032257.388826:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536600, rc 0) 00000100:00100000:0.0:1787032257.388888:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+21:11334:x1873838835042304:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 576us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032257.388902:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 145 00000100:00100000:0.0:1787032257.399299:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032257.399405:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835042560 00000100:00100000:1.0:1787032257.399414:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835042560 00000100:00100000:1.0:1787032257.399478:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 146 00000100:00100000:1.0:1787032257.399488:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+21:11334:x1873838835042560:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032257.399511:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032257.399534:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea25d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29ba expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.399653:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.399669:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.399690:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032257.399704:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787032257.399851:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea25d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29ba expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.399873:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29ba expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.399882:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864e00) 00010000:00010000:1.0:1787032257.399885:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032257.399889:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775600, rc 0) 00000100:00100000:1.0:1787032257.399956:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+23:11334:x1873838835042560:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 469us (666us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787032257.399978:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 146 00000100:00100000:2.0:1787032257.404127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032257.404167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032257.404253:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835042944 00000100:00100000:3.0:1787032257.404263:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835042944 00000100:00100000:3.0:1787032257.404343:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 147 00000100:00100000:3.0:1787032257.404353:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+23:11334:x1873838835042944:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032257.404378:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032257.404398:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.404498:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea279 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.404513:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.404525:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032257.404539:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787032257.404690:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29c1 expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.404711:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29c1 expref: 25 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.404719:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864e00) 00010000:00010000:3.0:1787032257.404723:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787032257.404726:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419e00, rc 0) 00000100:00100000:3.0:1787032257.404791:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+25:11334:x1873838835042944:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 439us (622us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787032257.404798:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 147 00000100:00100000:1.0:1787032257.405487:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835042688 00000100:00100000:1.0:1787032257.405495:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835042688 00000100:00100000:1.0:1787032257.405546:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:1.0:1787032257.405564:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+25:2354:x1873838835042688:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032257.405576:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032257.405595:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29ba expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.405611:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864e00) 00010000:00010000:1.0:1787032257.405615:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032257.405661:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:2354:x1873838835042688:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 108us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032257.405668:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:2.0:1787032257.413423:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032257.413512:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835043072 00000100:00100000:0.0:1787032257.413522:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835043072 00000100:00100000:0.0:1787032257.413609:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 50 00000100:00100000:0.0:1787032257.413619:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835043072:12345-192.168.201.48@tcp:1:lfs.0 00010000:00010000:0.0:1787032257.413666:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.413701:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.413710:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032257.413715:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032257.413720:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.413758:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.413772:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 6 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032257.413788:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6584:1873838857068544:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032257.413872:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032257.417535:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6584:1873838857068544:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032257.417574:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032257.420391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032257.420707:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835043200 00000100:00100000:1.0:1787032257.420716:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835043200 00002000:00100000:1.0:1787032257.420768:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99cde4983100 x1873838835043200/t0(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:118/0 lens 504/0 e 0 to 0 dl 1787032268 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032257.420780:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cde4983100 with x1873838835043200 ext(0->12) 00010000:00010000:1.0:1787032257.420790:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 7 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.420828:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 7 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787032257.420837:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99cde4983100 00000100:00100000:1.0:1787032257.420863:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:1.0:1787032257.420872:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835043200:12345-192.168.201.48@tcp:4:lfs.0 00000100:00100000:1.0:1787032257.421398:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:2355:x1873838835043200:12345-192.168.201.48@tcp:4:lfs.0 Request processed in 525us (1013us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787032257.421407:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 2 00002000:00100000:1.0:1787032257.421413:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99cde4983100 x1873838835043200/t4294967305(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:118/0 lens 504/448 e 0 to 0 dl 1787032268 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032257.421422:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cde4983100 with x1873838835043200 ext(0->12) 00010000:00010000:1.0:1787032257.421428:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 9 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.421440:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 9 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787032257.421448:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99cde4983100 00000100:00100000:0.0:1787032257.427305:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032257.427402:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835043328 00000100:00100000:1.0:1787032257.427413:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835043328 00010000:00010000:1.0:1787032257.427456:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 9 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032257.427520:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 64 00000100:00100000:1.0:1787032257.427531:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+9:2355:x1873838835043328:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032257.427548:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787032257.427579:0:11533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787032257.427582:0:11533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787032256 00002000:00010000:1.0:1787032257.427584:0:11533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787032256 00002000:00010000:1.0:1787032257.427586:0:11533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787032256 00010000:00010000:1.0:1787032257.427591:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 9 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.427605:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 9 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.427629:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006b3e080/0xcd047797ef1ea23a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29a5 expref: 9 pid: 6586 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.427646:0:11533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787032257.427651:0:11533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787032257.427657:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.427668:0:11533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.427716:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032257.427792:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+8:2355:x1873838835043328:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 263us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032257.427800:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 64 00010000:00010000:2.0:1787032257.428763:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.428778:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.428810:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.428818:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.428826:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.428834:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032257.428850:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.428859:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.428874:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.428882:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abd449fb/0xcd047797ef1ea287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032257.428966:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835043072:12345-192.168.201.48@tcp:1:lfs.0 Request processed in 15346us (15549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032257.428975:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 50 00000100:00100000:0.0:1787032257.432732:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032257.432814:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835043584 00000100:00100000:1.0:1787032257.432824:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835043584 00000100:00100000:1.0:1787032257.432890:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 38 00000100:00100000:1.0:1787032257.432901:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+24:11334:x1873838835043584:12345-192.168.201.48@tcp:35:lfs.0 00000004:00010000:1.0:1787032257.432970:0:5801:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29c1 expref: 24 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787032257.433285:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787032257.433332:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787032257.433863:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787032257.433926:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.433943:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.433952:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.433990:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.434010:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 28 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032257.434024:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfaf89500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1873838857068672:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032257.434278:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc892f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032257.437307:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfaf89500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1873838857068672:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032257.437354:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032257.438034:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032257.443225:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835043712 00000100:00100000:1.0:1787032257.443242:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835043712 00010000:00010000:1.0:1787032257.443304:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 29 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032257.443347:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 65 00000100:00100000:1.0:1787032257.443359:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b48850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+29:2354:x1873838835043712:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032257.443379:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032257.443386:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 29 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.443400:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 29 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.443424:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2997 expref: 29 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.443442:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864e00) 00010000:00010000:1.0:1787032257.443448:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.443458:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.443466:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.443501:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032257.443549:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.443558:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032257.443581:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b48850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+28:2354:x1873838835043712:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 224us (5549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032257.443601:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 65 00000001:00080000:2.0:1787032257.443694:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787032257.443901:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787032257.444010:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4982d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857068800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787032257.444172:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032257.444200:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfba4d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787032257.444538:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857068800 00000100:00100000:3.0:1787032257.444549:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857068800 00000100:00100000:3.0:1787032257.444604:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787032257.444613:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857068800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787032257.444694:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857068800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032257.444701:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787032257.444917:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032257.445381:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4982d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857068800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787032257.445838:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787032257.445903:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4982d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857068928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787032257.445942:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032257.445973:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc2afd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787032257.446478:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857068928 00000100:00100000:3.0:1787032257.446485:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857068928 00000100:00100000:3.0:1787032257.446543:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787032257.446551:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857068928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787032257.446728:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5801:x1873838857068928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (784us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787032257.446736:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787032257.446986:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4982d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857068928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787032257.447088:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787032257.447133:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.447144:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.447151:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.447158:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032257.447162:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.447170:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.447184:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864e00) 00010000:00010000:0.0:1787032257.447188:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787032257.447192:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.447198:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea28e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787032257.447388:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787032257.447522:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1787032257.447534:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412293465177ns, next at 413293463272ns, rc = 0 00000001:00080000:0.0:1787032257.447541:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787032257.447573:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864e00) 00010000:00010000:0.0:1787032257.447576:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787032257.447584:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea279 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29c1 expref: 32 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032257.447691:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+31:11334:x1873838835043584:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 14791us (14971us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787032257.447701:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 38 00000020:00080000:0.0:1787032257.447705:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787032257.450547:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032257.450673:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835043840 00000100:00100000:1.0:1787032257.450692:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835043840 00000100:00100000:1.0:1787032257.450756:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 148 00000100:00100000:1.0:1787032257.450766:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+31:11334:x1873838835043840:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032257.450790:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032257.450814:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29c8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.450880:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29c8 expref: 32 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.450896:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29c8 expref: 32 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032257.450916:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032257.450919:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787032257.450922:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775200, rc 0) 00000100:00100000:1.0:1787032257.450988:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+32:11334:x1873838835043840:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 223us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032257.450995:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 148 00000100:00100000:2.0:1787032257.464111:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032257.464457:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835044096 00000100:00100000:3.0:1787032257.464467:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835044096 00000100:00100000:3.0:1787032257.464528:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:3.0:1787032257.464538:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+32:11334:x1873838835044096:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032257.465037:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+33:11334:x1873838835044096:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 497us (933us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787032257.465046:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:3.0:1787032257.548342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032257.548560:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835044352 00000100:00100000:2.0:1787032257.548571:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835044352 00000100:00100000:2.0:1787032257.548646:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 149 00000100:00100000:2.0:1787032257.548657:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+33:11344:x1873838835044352:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032257.548694:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032257.548717:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea29c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032257.548842:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787032257.548965:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea29c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29cf expref: 35 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.548984:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:2.0:1787032257.548987:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032257.548993:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea29c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29cf expref: 35 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.549023:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6200, rc 0) 00000100:00100000:2.0:1787032257.549141:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+34:11344:x1873838835044352:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 486us (812us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787032257.549161:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 149 00000100:00100000:1.0:1787032257.559852:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032257.559940:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835044480 00000100:00100000:0.0:1787032257.559950:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835044480 00000100:00100000:0.0:1787032257.560007:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 150 00000100:00100000:0.0:1787032257.560017:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+34:11344:x1873838835044480:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:0.0:1787032257.560133:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560151:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560162:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560176:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560182:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560202:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560485:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560495:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560502:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787032257.560544:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560556:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560562:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560568:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560574:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032257.560578:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560585:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560598:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032257.560607:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032257.560613:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560621:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea2aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560637:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560642:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560647:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560651:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032257.560654:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560659:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560665:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc4f0a100) 00010000:00010000:0.0:1787032257.560666:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032257.560668:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560672:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea2b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560696:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560708:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560714:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560723:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032257.560726:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560732:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560739:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032257.560742:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032257.560744:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032257.560749:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032257.561051:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+34:11344:x1873838835044480:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 1033us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032257.561061:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 150 00000100:00100000:3.0:1787032257.562874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032257.562971:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835044736 00000100:00100000:2.0:1787032257.562979:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835044736 00000100:00100000:2.0:1787032257.563025:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:2.0:1787032257.563034:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+34:11344:x1873838835044736:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:2.0:1787032257.563348:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+35:11344:x1873838835044736:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 313us (483us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787032257.563355:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:3.0:1787032257.599828:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032257.599925:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835044992 00000100:00100000:2.0:1787032257.599935:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835044992 00000100:00100000:2.0:1787032257.599998:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 151 00000100:00100000:2.0:1787032257.600008:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+35:11347:x1873838835044992:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032257.600034:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032257.600057:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea2bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29d6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600178:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600195:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600206:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600220:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600246:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600254:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600384:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600394:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600401:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032257.600410:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787032257.600505:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600513:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600519:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600525:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032257.600529:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600536:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600559:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032257.600562:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032257.600566:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600572:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea2c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600585:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600591:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600597:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600602:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032257.600605:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600610:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600618:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc3864300) 00010000:00010000:2.0:1787032257.600620:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032257.600623:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600628:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea2cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600697:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea2bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 38 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600713:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 37 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.600720:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032257.600722:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032257.600725:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6600, rc 0) 00000100:00100000:2.0:1787032257.600791:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+37:11347:x1873838835044992:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 784us (971us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787032257.600800:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 151 00000100:00100000:1.0:1787032257.603669:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032257.603780:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835045120 00000100:00100000:2.0:1787032257.603789:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835045120 00000100:00100000:2.0:1787032257.603835:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 152 00000100:00100000:2.0:1787032257.603844:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+37:11347:x1873838835045120:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:2.0:1787032257.603912:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.603929:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.603940:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.603969:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.603994:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.604001:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.604008:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032257.604013:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.604020:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.604033:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032257.604036:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032257.604040:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032257.604046:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea2e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032257.604606:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+37:11347:x1873838835045120:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 751us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032257.604615:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 152 00000100:00100000:3.0:1787032257.606967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032257.607048:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835045376 00000100:00100000:2.0:1787032257.607057:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835045376 00000100:00100000:3.0:1787032257.607466:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:3.0:1787032257.607476:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+37:11347:x1873838835045376:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032257.607716:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+38:11347:x1873838835045376:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 240us (757us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787032257.607725:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:2.0:1787032257.964600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032257.964722:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835045632 00000100:00100000:3.0:1787032257.964734:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835045632 00000100:00100000:3.0:1787032257.964818:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 153 00000100:00100000:3.0:1787032257.964829:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+38:11379:x1873838835045632:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:3.0:1787032257.964855:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032257.964887:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea2e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.965006:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea2f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.965021:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.965034:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032257.965046:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787032257.965266:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea2e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29dd expref: 41 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.965286:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29dd expref: 40 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.965309:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:3.0:1787032257.965312:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032257.965316:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418800, rc 0) 00000100:00100000:3.0:1787032257.965386:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+40:11379:x1873838835045632:12345-192.168.201.48@tcp:101:cat.0 Request processed in 558us (796us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787032257.965394:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 153 00000100:00100000:1.0:1787032257.974193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032257.974483:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835045888 00000100:00100000:3.0:1787032257.974495:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835045888 00000100:00100000:3.0:1787032257.974562:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:3.0:1787032257.974582:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+40:11379:x1873838835045888:12345-192.168.201.48@tcp:35:cat.0 00000100:00100000:3.0:1787032257.974869:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+41:11379:x1873838835045888:12345-192.168.201.48@tcp:35:cat.0 Request processed in 297us (687us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787032257.974876:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:1.0:1787032257.975169:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032257.975473:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835046016 00000100:00100000:3.0:1787032257.975479:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835046016 00000100:00100000:3.0:1787032257.975522:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:3.0:1787032257.975529:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+41:2354:x1873838835046016:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787032257.975541:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032257.975566:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea2f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29dd expref: 41 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032257.975688:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:3.0:1787032257.975693:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032257.975731:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+40:2354:x1873838835046016:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 201us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032257.975755:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:1.0:1787032258.087470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032258.087841:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835046272 00000100:00100000:0.0:1787032258.087851:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835046272 00000100:00100000:0.0:1787032258.087929:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 154 00000100:00100000:0.0:1787032258.087940:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+40:11385:x1873838835046272:12345-192.168.201.48@tcp:101:dd.0 00010000:00010000:0.0:1787032258.087965:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032258.087974:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787032258.087999:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29b3 expref: 40 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.088018:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032258.088022:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032258.088035:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29e4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787032258.088369:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787032258.088574:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.088591:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 40 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.088599:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.088634:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 40 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.088649:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 40 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032258.088662:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb358e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857069056:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032258.088774:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032258.091602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032258.091710:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb358e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857069056:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032258.091736:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032258.091822:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835046400 00000100:00100000:2.0:1787032258.091830:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835046400 00010000:00010000:2.0:1787032258.091864:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 41 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032258.091904:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 66 00000100:00100000:2.0:1787032258.091914:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+41:2354:x1873838835046400:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032258.091938:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032258.091946:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 41 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.091958:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 41 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.091980:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea2d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29d6 expref: 41 pid: 5799 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.091995:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032258.092000:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.092009:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.092016:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.092042:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032258.092137:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+40:2354:x1873838835046400:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 224us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032258.092146:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 66 00010000:00010000:0.0:1787032258.092321:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.092329:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032258.092349:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787032258.092503:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea2fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 41 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.092519:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 40 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.092526:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032258.092529:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787032258.092531:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536000, rc 0) 00000100:00100000:0.0:1787032258.092557:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+40:11385:x1873838835046272:12345-192.168.201.48@tcp:101:dd.0 Request processed in 4620us (5104us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787032258.092564:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 154 00000100:00100000:3.0:1787032258.094883:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032258.094978:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835046656 00000100:00100000:2.0:1787032258.094989:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835046656 00000100:00100000:2.0:1787032258.095048:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 155 00000100:00100000:2.0:1787032258.095058:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+40:11385:x1873838835046656:12345-192.168.201.48@tcp:36:dd.0 00010000:00010000:2.0:1787032258.095373:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.095390:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.095402:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787032258.095452:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787032258.095475:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000624532fe reply state 0000000015315160 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032258.095485:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787032258.095582:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf486d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+43:11385:x1873838835046656:12345-192.168.201.48@tcp:36:dd.0 Request processed in 524us (707us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787032258.095590:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 155 00000020:00080000:2.0:1787032258.095594:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787032258.097630:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.097646:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.097653:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.097659:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032258.097672:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.097681:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.097709:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032258.097713:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032258.097718:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.097725:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea313 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.241603:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032258.308950:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf486dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857069184:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309041:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032258.309156:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857069696:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309185:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032258.309212:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787032258.309219:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf486f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857069568:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309257:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032258.309289:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf486fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857069440:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032258.309333:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787032258.309339:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857069312:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032258.309401:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857069824:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032258.309472:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857069568 00000100:00100000:1.0:1787032258.309479:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857069568 00000100:00100000:1.0:1787032258.309545:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857069824 00000100:00100000:1.0:1787032258.309549:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857069824 00000100:00100000:1.0:1787032258.309580:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787032258.309589:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857069568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309643:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857069568:12345-0@lo:400:kworker.0 Request processed in 54us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032258.309650:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787032258.309681:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787032258.309688:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857069824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309730:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857069824:12345-0@lo:400:kworker.0 Request processed in 42us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032258.309736:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787032258.309753:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787032258.309783:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857069824:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309810:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf486f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857069568:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309844:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857069184 00000100:00100000:1.0:1787032258.309848:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857069184 00000100:00100000:1.0:1787032258.309873:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787032258.309879:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857069184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309912:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857069184:12345-0@lo:400:kworker.0 Request processed in 34us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032258.309918:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787032258.309955:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf486dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857069184:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.309984:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857069696 00000100:00100000:1.0:1787032258.309988:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857069696 00000100:00100000:1.0:1787032258.310014:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857069440 00000100:00100000:1.0:1787032258.310017:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857069440 00000100:00100000:1.0:1787032258.310029:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857069312 00000100:00100000:1.0:1787032258.310032:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857069312 00000100:00100000:1.0:1787032258.310044:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787032258.310049:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857069696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.310115:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857069696:12345-0@lo:400:kworker.0 Request processed in 65us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032258.310122:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787032258.310133:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787032258.310146:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857069440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.310178:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857069440:12345-0@lo:400:kworker.0 Request processed in 33us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032258.310185:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787032258.310197:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787032258.310203:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857069312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.310228:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857069312:12345-0@lo:400:kworker.0 Request processed in 25us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032258.310233:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1787032258.310247:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032258.310263:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf486f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857069312:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.310272:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf486fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857069440:0@lo:400:kworker.0 00000100:00100000:1.0:1787032258.310295:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc8d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857069696:0@lo:400:kworker.0 00000100:00100000:2.0:1787032258.535520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032258.536393:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835046784 00000100:00100000:1.0:1787032258.536408:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835046784 00000100:00100000:1.0:1787032258.536480:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 156 00000100:00100000:1.0:1787032258.536492:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+42:11399:x1873838835046784:12345-192.168.201.48@tcp:101:stat.0 00010000:00010000:1.0:1787032258.536522:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032258.536547:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea31a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29eb expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.536628:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.536644:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.536685:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.536701:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.536708:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.536714:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.536992:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.537004:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.537011:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.537052:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.537226:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 43 pid: 5798 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032258.537243:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857069952:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032258.537409:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc892f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032258.543519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032258.543688:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857069952:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032258.543724:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032258.547941:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835047040 00000100:00100000:0.0:1787032258.547959:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835047040 00000100:00100000:0.0:1787032258.548174:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 43 00000100:00100000:0.0:1787032258.548188:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+44:5569:x1873838835047040:12345-192.168.201.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787032258.548886:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+45:5569:x1873838835047040:12345-192.168.201.48@tcp:35:ldlm_bl.0 Request processed in 699us (5375us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787032258.548895:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 43 00000100:00100000:3.0:1787032258.555235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032258.555390:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835047168 00000100:00100000:1.0:1787032258.555401:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835047168 00010000:00010000:1.0:1787032258.555447:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 45 pid: 5798 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032258.555496:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 67 00000100:00100000:1.0:1787032258.555507:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+45:2354:x1873838835047168:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032258.555526:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032258.555533:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 45 pid: 5798 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555547:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 45 pid: 5798 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555575:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea305 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29e4 expref: 45 pid: 5798 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555594:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032258.555599:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555609:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555618:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555673:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032258.555733:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+44:2354:x1873838835047168:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 227us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032258.555741:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 67 00010000:00010000:1.0:1787032258.555780:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555789:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032258.555844:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787032258.555849:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032258.555873:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555886:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555895:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555903:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555910:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555915:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032258.555920:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555940:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555949:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:1.0:1787032258.555952:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032258.555956:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555962:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555972:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555978:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555984:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555989:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032258.555991:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.555997:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.556004:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdce1ff100) 00010000:00010000:1.0:1787032258.556007:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032258.556009:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.556024:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea328 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.556065:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea31a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29eb expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.556134:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29eb expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.556142:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032258.556145:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032258.556148:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774200, rc 0) 00000100:00100000:1.0:1787032258.556177:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+43:11399:x1873838835046784:12345-192.168.201.48@tcp:101:stat.0 Request processed in 19687us (20667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032258.556184:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 156 00000100:00100000:3.0:1787032258.662743:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032258.662865:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835047424 00000100:00100000:0.0:1787032258.662876:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835047424 00000100:00100000:0.0:1787032258.662940:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 157 00000100:00100000:0.0:1787032258.662957:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+43:11405:x1873838835047424:12345-192.168.201.48@tcp:36:truncate.0 00010000:00010000:0.0:1787032258.663030:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032258.663060:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea32f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29eb expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.663131:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032258.663137:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032258.663371:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.663386:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.663395:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787032258.663445:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787032258.663467:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4f1adc4 reply state 00000000f841f8cd transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032258.663476:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787032258.663575:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+45:11405:x1873838835047424:12345-192.168.201.48@tcp:36:truncate.0 Request processed in 625us (842us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787032258.663582:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 157 00000020:00080000:0.0:1787032258.663587:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787032258.665110:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.665126:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.665133:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.665139:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032258.665143:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.665150:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.665184:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032258.665187:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032258.665192:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.665198:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea336 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787032258.817285:0:6612:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413663214857ns, next at 414663212002ns, rc = 0 00000100:00100000:2.0:1787032258.817365:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032258.817391:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857070080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032258.817468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032258.817600:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857070080 00000100:00100000:3.0:1787032258.817611:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857070080 00000100:00100000:3.0:1787032258.817672:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787032258.817682:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1873838857070080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787032258.817706:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032258.817764:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1873838857070080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032258.817772:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787032258.817868:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857070080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032258.818167:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787032258.818178:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdefbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857070208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032258.818212:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032258.818332:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857070208 00000100:00100000:0.0:1787032258.818350:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857070208 00000100:00100000:0.0:1787032258.818385:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787032258.818393:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857070208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032258.818419:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032258.818463:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857070208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032258.818470:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787032258.818551:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdefbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857070208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032258.828000:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032258.828528:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835047552 00000100:00100000:0.0:1787032258.828539:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835047552 00000100:00100000:0.0:1787032258.828606:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 158 00000100:00100000:0.0:1787032258.828616:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+44:11419:x1873838835047552:12345-192.168.201.48@tcp:101:stat.0 00010000:00010000:0.0:1787032258.828643:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032258.828676:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea33d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29f2 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828772:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828787:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828799:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828814:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828821:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828839:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828938:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828946:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.828954:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032258.828989:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787032258.828994:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032258.829033:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829044:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829052:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829059:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829106:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829113:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032258.829117:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829131:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829145:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032258.829148:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032258.829153:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829159:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea344 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829174:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829179:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829185:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829190:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032258.829193:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829198:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829205:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc4f0a100) 00010000:00010000:0.0:1787032258.829207:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032258.829210:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829228:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea34b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829541:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea33d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 46 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829557:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 45 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.829565:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032258.829567:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032258.829569:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536600, rc 0) 00000100:00100000:0.0:1787032258.829644:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+45:11419:x1873838835047552:12345-192.168.201.48@tcp:101:stat.0 Request processed in 1029us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032258.829660:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 158 00000100:00100000:3.0:1787032258.920214:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032258.920398:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835047808 00000100:00100000:0.0:1787032258.920410:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835047808 00000100:00100000:0.0:1787032258.920484:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 159 00000100:00100000:0.0:1787032258.920496:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+45:11429:x1873838835047808:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032258.920519:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032258.920544:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b29f9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032258.920683:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787032258.920834:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea359 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f9 expref: 47 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.920872:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:0.0:1787032258.920876:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787032258.920882:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f9 expref: 47 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.920897:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537000, rc 0) 00000100:00100000:0.0:1787032258.920968:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+46:11429:x1873838835047808:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 475us (764us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787032258.920975:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 159 00000100:00100000:3.0:1787032258.924191:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032258.924294:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835048064 00000100:00100000:2.0:1787032258.924304:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835048064 00000100:00100000:2.0:1787032258.924361:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:2.0:1787032258.924371:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+46:11429:x1873838835048064:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:2.0:1787032258.924667:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+47:11429:x1873838835048064:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 297us (487us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787032258.924675:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:3.0:1787032258.982329:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032258.982493:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835048320 00000100:00100000:1.0:1787032258.982502:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835048320 00000100:00100000:1.0:1787032258.982561:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 160 00000100:00100000:1.0:1787032258.982569:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+47:11435:x1873838835048320:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032258.982594:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032258.982614:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea367 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a00 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.982740:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.982755:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 48 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.982765:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.982808:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 48 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.982821:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 48 pid: 7755 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032258.982835:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857070336:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032258.983023:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc892f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032258.985925:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032258.986018:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835048448 00000100:00100000:2.0:1787032258.986028:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835048448 00010000:00010000:2.0:1787032258.986115:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 49 pid: 7755 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032258.986159:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 68 00000100:00100000:2.0:1787032258.986169:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4886d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+49:2355:x1873838835048448:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032258.986201:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032258.986208:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 49 pid: 7755 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.986220:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 49 pid: 7755 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.986255:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032258.986261:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.986270:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.986278:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.986299:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032258.986351:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4886d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+49:2355:x1873838835048448:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 182us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032258.986359:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 68 00010000:00010000:1.0:1787032258.986934:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29f2 expref: 48 pid: 7755 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032258.986951:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857070336:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032258.986976:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.986985:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.986991:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032258.987011:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787032258.987391:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea367 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 49 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.987412:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 48 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032258.987435:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032258.987438:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787032258.987441:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032258.987495:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+48:11435:x1873838835048320:12345-192.168.201.48@tcp:101:bash.0 Request processed in 4925us (5174us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787032258.987503:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 160 00000100:00100000:3.0:1787032258.991164:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032258.991287:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835048704 00000100:00100000:0.0:1787032258.991298:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835048704 00000100:00100000:0.0:1787032258.991377:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 161 00000100:00100000:0.0:1787032258.991389:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+48:11435:x1873838835048704:12345-192.168.201.48@tcp:36:bash.0 00010000:00010000:0.0:1787032258.991644:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.991673:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.991685:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787032258.991734:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787032258.991756:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7054590 reply state 0000000080667c2b transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032258.991765:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787032258.991861:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+51:11435:x1873838835048704:12345-192.168.201.48@tcp:36:bash.0 Request processed in 473us (704us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787032258.991868:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 161 00000020:00080000:0.0:1787032258.991872:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787032258.993835:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.993852:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.993859:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.993882:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032258.993887:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.993894:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.993909:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032258.993913:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032258.993917:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032258.993924:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea37c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032258.998041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032258.998444:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835048832 00000100:00100000:0.0:1787032258.998454:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835048832 00000100:00100000:0.0:1787032258.998517:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 162 00000100:00100000:0.0:1787032258.998528:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+50:11435:x1873838835048832:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032258.998556:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032258.998579:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea383 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a07 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.998676:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.998692:0:7755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.998701:0:7755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.998738:0:7755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032258.998753:0:7755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 51 pid: 5797 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032258.998768:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857070464:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032258.998850:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032259.001530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032259.001600:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835048960 00000100:00100000:1.0:1787032259.001609:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835048960 00010000:00010000:1.0:1787032259.001661:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 52 pid: 5797 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032259.001703:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 69 00000100:00100000:1.0:1787032259.001714:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+52:2354:x1873838835048960:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032259.001730:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032259.001739:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 52 pid: 5797 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.001753:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 52 pid: 5797 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.001781:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032259.001787:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.001795:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.001819:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.001840:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032259.001903:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+52:2354:x1873838835048960:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 190us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032259.001911:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 69 00010000:00010000:0.0:1787032259.002590:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea36e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a00 expref: 51 pid: 5797 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032259.002610:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb35b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857070464:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032259.002634:0:7755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.002643:0:7755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.002660:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032259.002707:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787032259.002721:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032259.002747:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.002782:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea383 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a07 expref: 51 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.002798:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a07 expref: 50 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.002806:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032259.002809:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032259.002811:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536000, rc 0) 00000100:00100000:0.0:1787032259.002858:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+50:11435:x1873838835048832:12345-192.168.201.48@tcp:101:bash.0 Request processed in 4331us (4826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032259.002865:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 162 00000100:00100000:3.0:1787032259.006451:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032259.006552:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835049216 00000100:00100000:2.0:1787032259.006562:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835049216 00000100:00100000:2.0:1787032259.006619:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:2.0:1787032259.006630:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+50:11435:x1873838835049216:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:2.0:1787032259.006889:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+51:11435:x1873838835049216:12345-192.168.201.48@tcp:35:bash.0 Request processed in 260us (447us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787032259.006896:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:3.0:1787032259.098965:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032259.099549:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835049472 00000100:00100000:0.0:1787032259.099562:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835049472 00000100:00100000:0.0:1787032259.099634:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 163 00000100:00100000:0.0:1787032259.099657:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+51:11445:x1873838835049472:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032259.099685:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032259.099707:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a0e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032259.099868:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787032259.099999:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea391 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a0e expref: 53 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.100028:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:0.0:1787032259.100032:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787032259.100037:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a0e expref: 53 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.100053:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537800, rc 0) 00000100:00100000:0.0:1787032259.100594:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+52:11445:x1873838835049472:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 947us (1636us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787032259.100603:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 163 00000100:00100000:3.0:1787032259.106176:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032259.106498:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835049600 00000100:00100000:1.0:1787032259.106510:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835049600 00000100:00100000:1.0:1787032259.106590:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 164 00000100:00100000:1.0:1787032259.106604:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+52:11445:x1873838835049600:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:1.0:1787032259.106720:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106738:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106750:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106765:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106772:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106779:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106889:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106911:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106918:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032259.106963:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106977:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106983:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106989:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.106995:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032259.106999:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107022:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107038:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:1.0:1787032259.107041:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032259.107046:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107053:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea39f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107314:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107322:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107329:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107334:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032259.107338:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107343:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107486:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdce1ff100) 00010000:00010000:1.0:1787032259.107488:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032259.107491:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107497:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea3a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107513:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107519:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107525:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107537:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032259.107540:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107546:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107554:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032259.107557:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032259.107560:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.107566:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea3ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032259.107705:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+52:11445:x1873838835049600:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 1102us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032259.107714:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 164 00000100:00100000:3.0:1787032259.111930:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032259.112055:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835049856 00000100:00100000:2.0:1787032259.112105:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835049856 00000100:00100000:2.0:1787032259.112170:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:2.0:1787032259.112181:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+52:11445:x1873838835049856:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:2.0:1787032259.112766:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+53:11445:x1873838835049856:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 583us (841us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787032259.112789:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:3.0:1787032259.152553:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032259.152746:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835050112 00000100:00100000:2.0:1787032259.152760:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835050112 00000100:00100000:2.0:1787032259.152835:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 165 00000100:00100000:2.0:1787032259.152848:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+53:11448:x1873838835050112:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032259.152887:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032259.152912:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea3b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a15 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153002:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153017:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153029:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153044:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153051:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153057:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153252:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea3c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153272:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea3c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153278:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea3c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032259.153288:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787032259.153387:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153394:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153401:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153407:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032259.153411:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153418:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153429:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032259.153432:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032259.153436:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153442:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea3bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153454:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153467:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153473:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153478:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032259.153482:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153488:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153496:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc3864300) 00010000:00010000:2.0:1787032259.153499:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032259.153501:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153507:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153551:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea3b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a15 expref: 56 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153565:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea3c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a15 expref: 55 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.153572:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032259.153575:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032259.153584:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6200, rc 0) 00000100:00100000:2.0:1787032259.153662:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+55:11448:x1873838835050112:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 816us (1121us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787032259.153671:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 165 00000100:00100000:1.0:1787032259.158495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032259.158599:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835050240 00000100:00100000:0.0:1787032259.158611:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835050240 00000100:00100000:0.0:1787032259.158696:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 166 00000100:00100000:0.0:1787032259.158707:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+55:11448:x1873838835050240:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:0.0:1787032259.158802:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158842:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158856:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158884:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158891:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158897:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158903:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032259.158907:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158914:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158925:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032259.158928:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787032259.158932:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.158939:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032259.159020:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+55:11448:x1873838835050240:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 313us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032259.159033:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 166 00000100:00100000:3.0:1787032259.161881:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032259.161977:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835050496 00000100:00100000:0.0:1787032259.161990:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835050496 00000100:00100000:0.0:1787032259.162253:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:0.0:1787032259.162265:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+55:11448:x1873838835050496:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:0.0:1787032259.162521:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+56:11448:x1873838835050496:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 258us (651us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787032259.165862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032259.165981:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835050624 00000100:00100000:1.0:1787032259.165993:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835050624 00000100:00100000:1.0:1787032259.166152:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:1.0:1787032259.166163:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+57:2356:x1873838835050624:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032259.166181:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032259.166210:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea3c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a15 expref: 57 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.166230:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032259.166258:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032259.166308:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4885c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+56:2356:x1873838835050624:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 147us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032259.166315:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:0.0:1787032259.170765:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 47 00010000:00010000:0.0:1787032259.265477:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032259.317906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032259.318006:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835050880 00000100:00100000:2.0:1787032259.318015:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835050880 00000100:00100000:2.0:1787032259.318119:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 167 00000100:00100000:2.0:1787032259.318129:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+55:11466:x1873838835050880:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:2.0:1787032259.318156:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032259.318180:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea3de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a1c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.318312:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.318328:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.318340:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032259.318351:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787032259.318476:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea3de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a1c expref: 58 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.318497:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a1c expref: 57 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.318507:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032259.318518:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787032259.318522:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032259.318729:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+57:11466:x1873838835050880:12345-192.168.201.48@tcp:101:cat.0 Request processed in 600us (835us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787032259.318736:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 167 00000100:00100000:3.0:1787032259.345473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032259.345621:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835051008 00000100:00100000:0.0:1787032259.345633:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835051008 00000100:00100000:0.0:1787032259.345706:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 168 00000100:00100000:0.0:1787032259.345718:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+57:11467:x1873838835051008:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032259.345743:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032259.345769:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a23 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.345837:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea3fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.345851:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.345861:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032259.345920:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787032259.345923:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032259.345964:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.345990:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea3f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a23 expref: 59 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.346008:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea3fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a23 expref: 58 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032259.346015:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032259.346018:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787032259.346021:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537c00, rc 0) 00000100:00100000:0.0:1787032259.346149:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+58:11467:x1873838835051008:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 431us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032259.346156:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 168 00000100:00100000:3.0:1787032259.351438:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032259.351585:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835051392 00000100:00100000:2.0:1787032259.351595:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835051392 00000100:00100000:2.0:1787032259.351665:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:2.0:1787032259.351677:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+58:11467:x1873838835051392:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:2.0:1787032259.352056:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+59:11467:x1873838835051392:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 379us (625us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787032259.352064:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:3.0:1787032259.354563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032259.354667:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835051520 00000100:00100000:1.0:1787032259.354675:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835051520 00000100:00100000:1.0:1787032259.354740:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:1.0:1787032259.354750:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+59:11467:x1873838835051520:12345-192.168.201.48@tcp:103:lfs.0 00010000:00010000:1.0:1787032259.354766:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787032259.354792:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea38a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a07 expref: 59 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.354817:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea3e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a1c expref: 58 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.354831:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b29c8 expref: 57 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032259.354842:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032259.354853:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032259.354916:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b4b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+56:11467:x1873838835051520:12345-192.168.201.48@tcp:103:lfs.0 Request processed in 167us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032259.354924:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:3.0:1787032259.357119:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032259.357218:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835051648 00000100:00100000:2.0:1787032259.357239:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835051648 00000100:00100000:2.0:1787032259.357299:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 169 00000100:00100000:2.0:1787032259.357309:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+56:11467:x1873838835051648:12345-192.168.201.48@tcp:58:lfs.0 00010000:00010000:2.0:1787032259.357413:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.357428:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.357439:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787032259.357727:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787032259.357818:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+56:11467:x1873838835051648:12345-192.168.201.48@tcp:58:lfs.0 Request processed in 510us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032259.357845:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 169 00000100:00100000:0.0:1787032259.378626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032259.378824:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835051776 00000100:00100000:2.0:1787032259.378835:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835051776 00000100:00100000:2.0:1787032259.378904:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 170 00000100:00100000:2.0:1787032259.378915:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+56:11469:x1873838835051776:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032259.378936:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032259.378958:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea408 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a2a expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379049:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379064:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379105:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379122:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379131:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379137:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379238:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379264:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379272:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032259.379309:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787032259.379313:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032259.379331:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379343:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379352:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379358:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379365:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379371:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032259.379376:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379384:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379395:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032259.379399:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032259.379412:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379419:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6000/0xcd047797ef1ea40f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379433:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379440:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379446:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379452:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032259.379455:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379460:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379468:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc3864d00) 00010000:00010000:2.0:1787032259.379471:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032259.379474:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379480:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379837:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea408 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 58 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379865:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 57 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032259.379873:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:2.0:1787032259.379875:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032259.379878:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7600, rc 0) 00000100:00100000:2.0:1787032259.380153:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+57:11469:x1873838835051776:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1155us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032259.380161:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 170 00000040:00080000:1.0:1787032260.138146:0:12321:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787032260.138155:0:12321:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787032260.138194:0:12321:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787032260.138204:0:12321:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787032260.162260:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032260.162272:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032260.162448:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787032260.162455:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787032260.162578:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb358a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857070592:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787032260.162684:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032260.177002:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb358a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857070592:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787032260.178033:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032260.178586:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835051904 00000100:00100000:2.0:1787032260.178597:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835051904 00000100:00100000:2.0:1787032260.178677:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 171 00000100:00100000:2.0:1787032260.178689:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+57:11480:x1873838835051904:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787032260.178723:0:5799:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787032260.178848:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+57:11480:x1873838835051904:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 160us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032260.178857:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 171 00000100:00080000:0.0:1787032260.181063:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032260.204171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032260.204360:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835052032 00000100:00100000:3.0:1787032260.204371:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835052032 00000100:00100000:3.0:1787032260.204437:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 172 00000100:00100000:3.0:1787032260.204448:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+57:11480:x1873838835052032:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787032260.204574:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.204594:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.204610:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.204639:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.204647:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.204655:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.204684:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.204703:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.204710:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032260.206584:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787032260.206594:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032260.206661:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.206681:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.206687:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.206694:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.206700:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032260.206704:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.206711:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.206727:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:3.0:1787032260.207855:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032260.207865:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207889:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea424 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207904:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207911:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207917:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207922:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032260.207926:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207932:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207944:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff99cdcba3af00) 00010000:00010000:3.0:1787032260.207946:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032260.207949:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207954:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea42b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207972:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207978:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207990:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.207995:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032260.207998:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.208003:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.208011:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:3.0:1787032260.208013:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032260.208016:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.208021:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.208148:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+57:11480:x1873838835052032:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 Request processed in 3697us (3983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032260.208159:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 172 00000100:00100000:0.0:1787032260.217777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032260.219902:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835052288 00000100:00100000:3.0:1787032260.219922:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835052288 00000100:00100000:3.0:1787032260.220000:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 173 00000100:00100000:3.0:1787032260.220012:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+57:11480:x1873838835052288:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032260.220035:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032260.220059:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea439 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a31 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220224:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220238:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220249:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032260.220262:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787032260.220363:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220371:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220378:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220384:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032260.220388:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220395:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220409:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:3.0:1787032260.220412:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787032260.220418:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220436:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220483:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea439 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a31 expref: 59 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220493:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:3.0:1787032260.220495:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787032260.220499:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea439 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a31 expref: 59 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.220508:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418c00, rc 0) 00000100:00100000:3.0:1787032260.220578:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+58:11480:x1873838835052288:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 567us (2812us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787032260.220586:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 173 00000100:00100000:2.0:1787032260.225990:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.227439:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835052416 00000100:00100000:0.0:1787032260.227453:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835052416 00000100:00100000:0.0:1787032260.227530:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 174 00000100:00100000:0.0:1787032260.227543:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+58:11480:x1873838835052416:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787032260.227640:0:7755:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787032260.227789:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+58:11480:x1873838835052416:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 249us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032260.227797:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 174 00000100:00100000:3.0:1787032260.230770:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032260.231382:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835052672 00000100:00100000:2.0:1787032260.231393:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835052672 00000100:00100000:2.0:1787032260.231460:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 175 00000100:00100000:2.0:1787032260.231470:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+58:11480:x1873838835052672:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032260.231494:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032260.231497:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787032260.231529:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea3fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a23 expref: 58 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.231559:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032260.231565:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032260.231580:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea44e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787032260.232059:0:5799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787032260.232361:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.232377:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.232388:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.232448:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea44e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a38 expref: 60 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.232465:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a38 expref: 59 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.232474:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc3864d00) 00010000:00010000:2.0:1787032260.232477:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032260.232480:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7c00, rc 0) 00000100:00100000:2.0:1787032260.232558:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+59:11480:x1873838835052672:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 1089us (1799us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787032260.232567:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 175 00000100:00100000:0.0:1787032260.241281:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032260.241675:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835052928 00000100:00100000:2.0:1787032260.241687:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835052928 00000100:00100000:2.0:1787032260.241767:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 176 00000100:00100000:2.0:1787032260.241780:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+59:11480:x1873838835052928:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787032260.241850:0:7755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032260.241883:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a38 expref: 59 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.241915:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc3864d00) 00010000:00010000:2.0:1787032260.241928:0:7755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032260.241962:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.241977:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.241987:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242054:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242063:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242099:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242182:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242201:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242208:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242214:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032260.242219:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242227:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242237:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032260.242240:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032260.242244:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242251:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea463 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242261:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242267:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242273:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242278:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032260.242288:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242296:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242305:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x833df28d (ffff99cdc3864500) 00010000:00010000:2.0:1787032260.242308:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032260.242311:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.242317:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea46a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x833df28d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032260.242408:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+58:11480:x1873838835052928:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 630us (1137us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787032260.242417:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 176 00000100:00100000:3.0:1787032260.246645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.246789:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835053056 00000100:00100000:0.0:1787032260.246801:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835053056 00000100:00100000:0.0:1787032260.246869:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 177 00000100:00100000:0.0:1787032260.246880:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+58:11480:x1873838835053056:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032260.246903:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032260.246950:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea471 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.246989:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.247004:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.247015:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.247153:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.247172:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.247187:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:0.0:1787032260.247190:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787032260.247194:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537000, rc 0) 00000100:00100000:0.0:1787032260.247255:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+59:11480:x1873838835053056:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 377us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032260.247262:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 177 00000100:00100000:3.0:1787032260.251488:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.251562:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835053312 00000100:00100000:0.0:1787032260.251572:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835053312 00000100:00100000:0.0:1787032260.251691:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 178 00000100:00100000:0.0:1787032260.251702:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+59:11480:x1873838835053312:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787032260.251790:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.251809:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.251819:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787032260.252192:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787032260.252203:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415098135261ns, next at 416098133146ns, rc = 0 00000004:00010000:1.0:1787032260.260523:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000063db0ff4 reply state 00000000983a2ae8 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032260.260543:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787032260.260700:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+61:11480:x1873838835053312:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 8995us (9218us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787032260.260709:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 178 00000100:00100000:0.0:1787032260.272850:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032260.272919:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835053440 00000100:00100000:2.0:1787032260.272929:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835053440 00000100:00100000:2.0:1787032260.272991:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 179 00000100:00100000:2.0:1787032260.273002:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+61:11480:x1873838835053440:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032260.273028:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032260.273052:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a46 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.273172:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 62 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.273189:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 62 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.273221:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:2.0:1787032260.273225:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787032260.273229:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6400, rc 0) 00000100:00100000:2.0:1787032260.273293:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+62:11480:x1873838835053440:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 292us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032260.273301:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 179 00010000:00010000:3.0:1787032260.274344:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.274360:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.274367:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.274373:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032260.274387:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.274394:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.274408:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:3.0:1787032260.274412:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787032260.274416:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.274422:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea47f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.295463:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032260.299800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032260.299872:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835053568 00000100:00100000:1.0:1787032260.299882:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835053568 00000100:00100000:1.0:1787032260.299954:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00100000:1.0:1787032260.299964:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835053568:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787032260.300329:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835053568:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 366us (540us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787032260.300337:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00080000:0.0:1787032260.300766:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032260.305297:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.305395:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835053824 00000100:00100000:0.0:1787032260.305405:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835053824 00000100:00100000:0.0:1787032260.305476:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:0.0:1787032260.305486:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+61:11480:x1873838835053824:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787032260.305753:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+62:11480:x1873838835053824:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 267us (464us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787032260.305761:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:0.0:1787032260.314424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032260.314593:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835054080 00000100:00100000:1.0:1787032260.314603:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835054080 00000100:00100000:1.0:1787032260.314678:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 180 00000100:00100000:1.0:1787032260.314689:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+62:11480:x1873838835054080:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787032260.314819:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+62:11480:x1873838835054080:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 132us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032260.314827:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 180 00000100:00100000:3.0:1787032260.317307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.317474:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835054208 00000100:00100000:0.0:1787032260.317484:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835054208 00000100:00100000:0.0:1787032260.317547:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 181 00000100:00100000:0.0:1787032260.317556:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+62:11480:x1873838835054208:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032260.317576:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032260.317596:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea48d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a4d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.317693:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea494 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.317707:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.317719:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032260.317755:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032260.317774:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.317799:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea48d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a4d expref: 64 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.317815:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a4d expref: 63 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.317830:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:0.0:1787032260.317834:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787032260.317838:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537800, rc 0) 00000100:00100000:0.0:1787032260.317892:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+63:11480:x1873838835054208:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 336us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032260.317899:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 181 00000100:00100000:0.0:1787032260.327822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032260.328148:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835054336 00000100:00100000:3.0:1787032260.328159:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835054336 00000100:00100000:3.0:1787032260.328215:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00100000:3.0:1787032260.328225:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835054336:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032260.328244:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032260.328265:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a54 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787032260.328293:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a83f2c3, blocks: 0x1 00010000:00010000:3.0:1787032260.328313:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787032260.328318:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032260.328329:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.328369:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.328382:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418800, rc 0) 00000100:00100000:3.0:1787032260.328446:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835054336:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 211us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032260.328453:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00100000:1.0:1787032260.340230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032260.340357:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835054592 00000100:00100000:3.0:1787032260.340366:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835054592 00000100:00100000:3.0:1787032260.340424:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 182 00000100:00100000:3.0:1787032260.340574:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+63:11480:x1873838835054592:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787032260.340696:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+63:11480:x1873838835054592:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 261us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032260.340703:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 182 00000100:00100000:3.0:1787032260.347449:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032260.347849:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835054720 00000100:00100000:1.0:1787032260.347860:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835054720 00000100:00100000:1.0:1787032260.347973:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:1.0:1787032260.347985:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:11480:x1873838835054720:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787032260.348015:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032260.348036:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a5b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.348105:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.348115:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032260.348120:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032260.348125:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.348169:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.348184:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 9 pid: 6584 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032260.348199:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1873838857070720:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032260.351473:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc65c0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032260.360977:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.361016:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835054848 00000100:00100000:0.0:1787032260.361025:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835054848 00010000:00010000:0.0:1787032260.361105:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 10 pid: 6584 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032260.361155:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 70 00000100:00100000:0.0:1787032260.361166:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+10:2355:x1873838835054848:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032260.361183:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032260.361207:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 10 pid: 6584 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.361221:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 10 pid: 6584 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.361248:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032260.361253:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032260.361279:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 10 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.361289:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 10 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.361331:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 10 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032260.361347:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb35ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1873838857070848:192.168.201.48@tcp:105: 00000100:00100000:0.0:1787032260.361421:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6fd80 going to sleep for 11 seconds 00010000:00010000:3.0:1787032260.362544:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea49b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a54 expref: 10 pid: 6584 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.362565:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6587:1873838857070720:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032260.362595:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.362609:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774200, rc 0) 00000100:00100000:3.0:1787032260.362676:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:11480:x1873838835054720:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 14694us (15250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032260.362684:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:0.0:1787032260.369427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.369497:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835054976 00000100:00100000:0.0:1787032260.369507:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835054976 00002000:00100000:0.0:1787032260.369566:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99cdfb359880 x1873838835054976/t0(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:121/0 lens 504/0 e 0 to 0 dl 1787032271 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787032260.369577:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdfb359880 with x1873838835054976 ext(0->8) 00002000:00010000:0.0:1787032260.369582:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdfb359880 00000100:00100000:0.0:1787032260.369610:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:0.0:1787032260.369620:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835054976:12345-192.168.201.48@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787032260.370124:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d144536-0f5d-43dc-8f25-f68546215872+11:2354:x1873838835054976:12345-192.168.201.48@tcp:4:lhsmtool_posix.0 Request processed in 504us (706us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787032260.370134:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 4 00002000:00100000:0.0:1787032260.370141:0:6591:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99cdfb359880 x1873838835054976/t4294967314(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:121/0 lens 504/448 e 0 to 0 dl 1787032271 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787032260.370162:0:6591:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdfb359880 with x1873838835054976 ext(0->8) 00002000:00010000:0.0:1787032260.370166:0:6591:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdfb359880 00000100:00100000:3.0:1787032260.370544:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb35ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1873838857070848:192.168.201.48@tcp:105: 00010000:00010000:3.0:1787032260.370568:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032260.370608:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+10:2355:x1873838835054848:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 9445us (9641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032260.370617:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 70 00000100:00100000:1.0:1787032260.385449:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.385664:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835055104 00000100:00100000:0.0:1787032260.385675:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835055104 00000100:00100000:0.0:1787032260.385737:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 183 00000100:00100000:0.0:1787032260.385747:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+63:11480:x1873838835055104:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787032260.463651:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+63:11480:x1873838835055104:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 Request processed in 77891us (78201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032260.463665:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 183 00000001:00080000:2.0:1787032260.463895:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787032260.463907:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787032260.463941:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1787032260.463974:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787032260.464042:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cdfba4dc00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787032260.464047:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdef0f7c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cdfba4d600 00000020:00080000:2.0:1787032260.464050:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdef0f7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdfb31b400 00000100:00100000:3.0:1787032260.464386:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032260.464406:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857070976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787032260.464470:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032260.464535:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787032260.464545:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857071104:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787032260.464570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032260.464605:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857070976 00000100:00100000:3.0:1787032260.464614:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857070976 00000100:00100000:3.0:1787032260.464689:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857071104 00000100:00100000:3.0:1787032260.464693:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857071104 00000100:00100000:3.0:1787032260.464718:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787032260.464727:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857070976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787032260.464755:0:6584:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1787032260.464788:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a83f2c0, atime: 0x6a83f2c0, ctime: 0x6a83f2c0, blocks: 0x1 00010000:00010000:3.0:1787032260.464796:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.464812:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787032260.464817:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032260.464840:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.464858:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.464869:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.464876:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.464894:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787032260.465471:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857070976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 742us (997us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787032260.465479:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787032260.465498:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787032260.465506:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857071104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787032260.465922:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787032260.465926:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787032259 00002000:00010000:3.0:1787032260.465928:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787032260.465929:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787032259 -> 1787032259 00002000:00010000:3.0:1787032260.465931:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787032260.465969:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857071104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 465us (1398us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787032260.465973:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:3.0:1787032260.466022:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cdff65ce00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787032260.466034:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857070976:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787032260.466103:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ccc3691f80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787032260.466110:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857071104:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1787032260.466221:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787032260.466353:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:0.0:1787032260.466366:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032260.466369:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787032260.466376:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032260.466383:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.466391:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032260.466395:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.466402:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.466420:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.466424:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd99f13d/0xcd047797ef1ea4a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.466450:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032260.466451:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032260.466453:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032260.466570:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032260.466671:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835055232 00000100:00100000:2.0:1787032260.466678:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835055232 00000100:00100000:2.0:1787032260.466738:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 56 00000100:00100000:2.0:1787032260.466744:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+10:2357:x1873838835055232:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787032260.487458:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+10:2357:x1873838835055232:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 Request processed in 20701us (20880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032260.487472:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 56 00000001:00080000:2.0:1787032260.487521:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1787032260.487541:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1787032260.492490:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032260.494227:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835055488 00000100:00100000:1.0:1787032260.494265:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835055488 00000100:00100000:1.0:1787032260.494362:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 184 00000100:00100000:1.0:1787032260.494373:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+18:11480:x1873838835055488:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787032260.494446:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032260.494490:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537800/0xcd047797ef1ea494 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a4d expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.494520:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:1.0:1787032260.494528:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032260.494566:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.494580:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.494591:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032260.494867:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000178d7f6f reply state 000000006e840ccb transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032260.494877:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787032260.495006:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+19:11480:x1873838835055488:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 633us (2526us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787032260.495014:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 184 00010000:00010000:2.0:1787032260.502212:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.502232:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.502240:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.502245:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032260.502251:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.502259:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.502277:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:2.0:1787032260.502280:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032260.502284:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.502290:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea4b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.502720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.502799:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835055616 00000100:00100000:0.0:1787032260.502811:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835055616 00000100:00100000:0.0:1787032260.502881:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 57 00000100:00100000:0.0:1787032260.502891:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835055616:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787032260.503826:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787032260.503833:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787032259 -> 1787032258 00002000:00010000:1.0:1787032260.503835:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787032256 00002000:00010000:1.0:1787032260.503837:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787032259 -> 1787032258 00002000:00010000:1.0:1787032260.503852:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787032260.503925:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835055616:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 1032us (1209us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787032260.503934:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 57 00000100:00100000:1.0:1787032260.506229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032260.506364:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835055872 00000100:00100000:3.0:1787032260.506374:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835055872 00000100:00100000:3.0:1787032260.506439:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 185 00000100:00100000:3.0:1787032260.506449:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+18:11480:x1873838835055872:12345-192.168.201.48@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787032260.506520:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.506546:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.506555:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.506590:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.506602:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 18 pid: 5798 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.506618:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857071232:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032260.506711:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032260.513468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032260.513610:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835056000 00000100:00100000:1.0:1787032260.513631:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835056000 00010000:00010000:1.0:1787032260.513678:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 19 pid: 5798 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032260.513734:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 71 00000100:00100000:1.0:1787032260.513745:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+19:2354:x1873838835056000:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032260.513761:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032260.513769:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 19 pid: 5798 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.513783:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 19 pid: 5798 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.513807:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:1.0:1787032260.513813:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.513822:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.513830:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.513868:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032260.513927:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+19:2354:x1873838835056000:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 183us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032260.513935:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 71 00010000:00010000:3.0:1787032260.514297:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea478 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a3f expref: 18 pid: 5798 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.514315:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857071232:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032260.514353:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514363:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514369:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514400:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514407:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514413:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514419:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032260.514423:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514430:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514440:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:3.0:1787032260.514443:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787032260.514446:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.514452:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.514514:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+17:11480:x1873838835055872:12345-192.168.201.48@tcp:55:lhsmtool_posix.0 Request processed in 8067us (8293us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787032260.514522:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 185 00000100:00100000:2.0:1787032260.527512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032260.527672:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835056128 00000100:00100000:3.0:1787032260.527681:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835056128 00000100:00100000:3.0:1787032260.527742:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 58 00000100:00100000:3.0:1787032260.527752:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835056128:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787032260.527797:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.527819:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.527828:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032260.527832:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787032260.527837:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.527871:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.527887:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 8 pid: 6587 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.527902:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6584:1873838857071360:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032260.527999:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032260.531596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.531790:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835056256 00000100:00100000:0.0:1787032260.531800:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835056256 00010000:00010000:0.0:1787032260.531846:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 9 pid: 6587 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032260.531904:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 72 00000100:00100000:0.0:1787032260.531914:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835056256:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032260.531930:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032260.531953:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 9 pid: 6587 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.531966:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 9 pid: 6587 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.531996:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032260.532001:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032260.532008:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.532040:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.532097:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032260.532165:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835056256:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 251us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032260.532173:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 72 00010000:00010000:3.0:1787032260.532839:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000940d6662/0xcd047797ef1ea4a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a5b expref: 8 pid: 6587 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.532959:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6584:1873838857071360:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032260.532981:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.532993:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.533000:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.533028:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.533037:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.533045:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.533053:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032260.533057:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.533646:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.533664:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.533671:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea4be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032260.533797:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835056128:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 Request processed in 6043us (6292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032260.533807:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 58 00000100:00100000:2.0:1787032260.537928:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032260.540205:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835056512 00000100:00100000:1.0:1787032260.540222:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835056512 00000100:00100000:1.0:1787032260.540331:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 186 00000100:00100000:1.0:1787032260.540353:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+17:11480:x1873838835056512:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787032260.540444:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.540463:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.540476:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.540698:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.540709:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.540718:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.540753:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.540790:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 18 pid: 5799 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032260.540807:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857071488:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032260.541606:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787032260.543851:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857071488:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032260.543944:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032260.547492:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032260.547738:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835056640 00000100:00100000:1.0:1787032260.547749:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835056640 00010000:00010000:1.0:1787032260.547791:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 19 pid: 5799 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032260.547888:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 73 00000100:00100000:1.0:1787032260.547899:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+19:2354:x1873838835056640:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032260.547919:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032260.547926:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 19 pid: 5799 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.547939:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 19 pid: 5799 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.547965:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea486 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a46 expref: 19 pid: 5799 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.547981:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:1.0:1787032260.547986:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.547997:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.548024:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032260.548048:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032260.548130:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032260.548139:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032260.548150:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+18:2354:x1873838835056640:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 253us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032260.548158:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 73 00000001:00080000:3.0:1787032260.548395:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787032260.548684:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787032260.548736:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787032260.548835:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1873838857071616:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787032260.549125:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032260.549221:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032260.549470:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857071616 00000100:00100000:2.0:1787032260.549482:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857071616 00000100:00100000:2.0:1787032260.549599:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787032260.549606:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1873838857071616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787032260.549719:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1873838857071616:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032260.549724:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787032260.549771:0:5797:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787032260.549775:0:5797:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99ccc3691f80, transno 4294967315 00000100:00100000:3.0:1787032260.549813:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1873838857071616:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787032260.550735:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787032260.550791:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb35aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1873838857071744:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787032260.550823:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032260.550847:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787032260.550877:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857071744 00000100:00100000:1.0:1787032260.550882:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857071744 00000100:00100000:1.0:1787032260.550917:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787032260.550925:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1873838857071744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787032260.551105:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1873838857071744:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (278us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787032260.551113:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787032260.551191:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb35aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5797:1873838857071744:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787032260.551412:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551420:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551425:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551429:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032260.551432:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551436:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551456:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:0.0:1787032260.551458:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032260.551461:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551465:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551489:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551492:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551496:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551499:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032260.551501:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551504:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551508:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:0.0:1787032260.551509:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032260.551511:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551514:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea401 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551538:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551552:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 21 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551560:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551587:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 21 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.551600:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 21 pid: 7755 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032260.551608:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff535f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857071872:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032260.551725:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe6f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787032260.555409:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff535f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5797:1873838857071872:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032260.555439:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032260.555977:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.556058:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835056768 00000100:00100000:0.0:1787032260.556065:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835056768 00010000:00010000:0.0:1787032260.556117:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 22 pid: 7755 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032260.556150:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 74 00000100:00100000:0.0:1787032260.556159:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+22:2354:x1873838835056768:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032260.556292:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032260.556302:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 22 pid: 7755 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.556315:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 22 pid: 7755 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.556340:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea41d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a2a expref: 22 pid: 7755 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.556364:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:0.0:1787032260.556370:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.556380:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.556389:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.556417:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032260.556473:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+21:2354:x1873838835056768:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 315us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032260.556481:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 74 00010000:00010000:2.0:1787032260.556657:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556665:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556678:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556684:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556690:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556697:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032260.556701:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556708:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556718:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:2.0:1787032260.556721:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032260.556733:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556739:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea4d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556751:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556757:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556762:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556767:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032260.556769:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556774:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556782:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:2.0:1787032260.556784:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787032260.556786:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.556791:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032260.557138:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:11480:x1873838835056512:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 16796us (19218us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1787032260.557147:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 186 00000020:00080000:2.0:1787032260.557157:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787032260.560302:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032260.560497:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835057024 00000100:00100000:0.0:1787032260.560506:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835057024 00000100:00100000:0.0:1787032260.560564:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 50 00000100:00100000:0.0:1787032260.560574:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+20:11480:x1873838835057024:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787032260.561600:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787032260.561714:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787032260.561762:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.561780:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.561792:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.561801:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.561807:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.561813:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032260.561834:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787032260.561944:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+22:11480:x1873838835057024:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 1367us (1647us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787032260.561953:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 50 00000020:00080000:0.0:1787032260.561958:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787032260.562160:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032260.562167:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.562174:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032260.562179:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.562186:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.562330:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99cdc4f0a400) 00010000:00010000:2.0:1787032260.562334:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787032260.562339:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.562355:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea4da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032260.562376:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032260.562378:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032260.562379:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787032260.564968:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787032260.564978:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787032260.565868:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787032260.565882:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787032261.250477:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032261.250520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032261.250553:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032261.250584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032261.250635:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835057664 00000100:00100000:3.0:1787032261.250643:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032261.250646:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835057664 00000100:00100000:3.0:1787032261.250664:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835057280 00000100:00100000:3.0:1787032261.250668:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835057280 00000100:00100000:1.0:1787032261.250716:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 154 00000100:00100000:1.0:1787032261.250727:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838835057664:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032261.250743:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835057408 00000100:00100000:2.0:1787032261.250747:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835057408 00000100:00100000:2.0:1787032261.250775:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835057536 00000100:00100000:2.0:1787032261.250777:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835057536 00000100:00100000:1.0:1787032261.250804:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838835057664:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032261.250810:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 90 00000100:00100000:2.0:1787032261.250816:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835057408:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032261.250824:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 154 00000100:00100000:1.0:1787032261.250841:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 155 00000100:00100000:2.0:1787032261.250843:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835057408:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032261.250847:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+22:2354:x1873838835057280:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032261.250850:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 90 00000100:00100000:2.0:1787032261.250876:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 91 00000100:00100000:1.0:1787032261.250876:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+22:2354:x1873838835057280:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032261.250882:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835057536:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032261.250891:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 155 00000100:00100000:2.0:1787032261.250903:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835057536:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 22us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032261.250909:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 91 00000100:00100000:0.0:1787032261.250954:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835057152 00000100:00100000:0.0:1787032261.250959:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835057152 00000100:00100000:0.0:1787032261.250999:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 293 00000100:00100000:0.0:1787032261.251006:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838835057152:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032261.251039:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838835057152:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032261.251053:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 293 00000100:00080000:0.0:1787032261.251115:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787032261.251120:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787032261.313291:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787032262.038312:0:12373:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032262.038321:0:12373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032262.038369:0:12373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787032262.038375:0:12373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787032262.151277:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032262.152785:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835057920 00000100:00100000:1.0:1787032262.152801:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835057920 00000100:00100000:1.0:1787032262.152894:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 187 00000100:00100000:1.0:1787032262.152906:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+22:11498:x1873838835057920:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032262.152931:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032262.152970:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a62 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.153285:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787032262.153293:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787032262.153301:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.153314:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032262.153326:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787032262.153489:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea4e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a62 expref: 25 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.153507:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a62 expref: 24 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.153515:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:1.0:1787032262.153519:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787032262.153522:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775a00, rc 0) 00000100:00100000:1.0:1787032262.153611:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+24:11498:x1873838835057920:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 708us (2345us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787032262.153619:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 187 00000100:00100000:3.0:1787032262.165428:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032262.165471:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835058048 00000100:00100000:3.0:1787032262.165482:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835058048 00000100:00100000:3.0:1787032262.165543:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 188 00000100:00100000:3.0:1787032262.165554:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:11498:x1873838835058048:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:3.0:1787032262.165655:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.165674:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.165688:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.165736:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.165759:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.165767:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166113:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166121:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166128:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032262.166166:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166178:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166184:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166190:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166196:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032262.166200:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166206:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166225:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:3.0:1787032262.166229:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032262.166234:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166240:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea4f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166253:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166259:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166264:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166269:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032262.166272:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166278:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166285:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdcba3af00) 00010000:00010000:3.0:1787032262.166287:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032262.166289:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166295:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea4fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166318:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166324:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166329:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166334:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032262.166337:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166342:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166348:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdcba3ab00) 00010000:00010000:3.0:1787032262.166351:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032262.166353:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.166358:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032262.166437:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:11498:x1873838835058048:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 883us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032262.166446:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 188 00000100:00100000:2.0:1787032262.233654:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032262.235358:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835058304 00000100:00100000:1.0:1787032262.235369:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835058304 00000100:00100000:1.0:1787032262.235421:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 189 00000100:00100000:1.0:1787032262.235430:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+24:11501:x1873838835058304:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032262.235449:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032262.235468:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea50b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a69 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.235554:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.235568:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.235579:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.235604:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.235611:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.235617:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.235932:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238537:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238551:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032262.238570:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787032262.238712:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238720:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238727:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238733:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032262.238737:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238744:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238758:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:1.0:1787032262.238762:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032262.238766:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238772:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea512 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238783:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238796:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238801:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238806:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032262.238809:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238815:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238823:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdce1ffc00) 00010000:00010000:1.0:1787032262.238825:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032262.238828:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238833:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea519 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238890:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea50b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238906:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 26 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.238913:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:1.0:1787032262.238916:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032262.238924:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032262.242154:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+26:11501:x1873838835058304:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 6710us (8496us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787032262.242169:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 189 00000100:00100000:2.0:1787032262.256154:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032262.256203:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835058432 00000100:00100000:2.0:1787032262.256213:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835058432 00000100:00100000:2.0:1787032262.256402:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 190 00000100:00100000:2.0:1787032262.256414:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+26:11501:x1873838835058432:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:2.0:1787032262.256485:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256501:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256513:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256544:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256563:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256570:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256576:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032262.256581:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256623:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256637:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:2.0:1787032262.256640:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032262.256645:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.256652:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea52e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032262.256728:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+26:11501:x1873838835058432:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 315us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032262.256737:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 190 00000100:00100000:0.0:1787032262.267900:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032262.277751:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835058688 00000100:00100000:2.0:1787032262.277768:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835058688 00000100:00100000:2.0:1787032262.277897:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00100000:2.0:1787032262.277910:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+26:11501:x1873838835058688:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:2.0:1787032262.278195:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+27:11501:x1873838835058688:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 287us (10304us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787032262.278214:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00100000:2.0:1787032262.327720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032262.327832:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835058944 00000100:00100000:1.0:1787032262.327842:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835058944 00000100:00100000:1.0:1787032262.327909:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 191 00000100:00100000:1.0:1787032262.327920:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+27:11028:x1873838835058944:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032262.327960:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032262.327984:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea535 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a70 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.328148:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.328165:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.328175:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.328210:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.328224:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 28 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032262.328250:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857072000:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032262.328356:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cc16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032262.330806:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857072000:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032262.330839:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032262.332116:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032262.332151:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835059072 00000100:00100000:0.0:1787032262.332161:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835059072 00010000:00010000:0.0:1787032262.332203:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 29 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032262.332412:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00100000:0.0:1787032262.332424:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+29:2355:x1873838835059072:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032262.332440:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032262.332448:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 29 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.332462:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 29 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.332484:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a69 expref: 29 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.332500:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:0.0:1787032262.332517:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.332527:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.332534:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.332571:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032262.332829:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.332839:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032262.332866:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787032262.333035:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea535 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 30 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.333052:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.333060:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:3.0:1787032262.333063:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787032262.333087:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775600, rc 0) 00000100:00100000:3.0:1787032262.333157:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:11028:x1873838835058944:12345-192.168.201.48@tcp:101:bash.0 Request processed in 5240us (5450us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787032262.333166:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 191 00000100:00100000:0.0:1787032262.334382:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+28:2355:x1873838835059072:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 1953us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032262.334395:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 75 00010000:00010000:2.0:1787032262.338526:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032262.345377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032262.345483:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835059328 00000100:00100000:3.0:1787032262.345495:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835059328 00000100:00100000:3.0:1787032262.345567:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 192 00000100:00100000:3.0:1787032262.345577:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+28:11028:x1873838835059328:12345-192.168.201.48@tcp:36:bash.0 00010000:00010000:3.0:1787032262.345890:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.345907:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.345919:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787032262.345977:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787032262.346431:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000060d61dbd reply state 000000007856f7eb transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032262.346443:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787032262.346509:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787032262.346999:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+32:11028:x1873838835059328:12345-192.168.201.48@tcp:36:bash.0 Request processed in 1419us (1628us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787032262.347020:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 192 00000020:00080000:2.0:1787032262.347638:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787032262.349434:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.349462:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.349470:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.349476:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032262.349481:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.349489:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.349518:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:3.0:1787032262.349522:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032262.349527:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.349533:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea54a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032262.351222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032262.353822:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835059456 00000100:00100000:1.0:1787032262.353835:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835059456 00000100:00100000:1.0:1787032262.353901:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 193 00000100:00100000:1.0:1787032262.353912:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+31:11028:x1873838835059456:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032262.353947:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032262.353966:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea551 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a77 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.354020:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a77 expref: 32 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.354031:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a77 expref: 32 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.354045:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:1.0:1787032262.354047:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787032262.354050:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775200, rc 0) 00000100:00100000:1.0:1787032262.354132:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+32:11028:x1873838835059456:12345-192.168.201.48@tcp:101:bash.0 Request processed in 222us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032262.354138:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 193 00000100:00100000:2.0:1787032262.357761:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032262.358002:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835059584 00000100:00100000:0.0:1787032262.358014:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835059584 00000100:00100000:0.0:1787032262.358126:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 59 00000100:00100000:0.0:1787032262.358135:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:11028:x1873838835059584:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032262.358152:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032262.358173:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a7e expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787032262.358205:0:6586:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a83f2c2, atime: 0x6a83f2c0, ctime: 0x6a83f2c2, blocks: 0xb 00010000:00010000:0.0:1787032262.358226:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1787032262.358231:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032262.358239:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.358254:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 8 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.358284:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537800, rc 0) 00000100:00100000:0.0:1787032262.358338:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+8:11028:x1873838835059584:12345-192.168.201.48@tcp:101:bash.0 Request processed in 203us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032262.358346:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 59 00000100:00080000:3.0:1787032262.358726:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032262.366472:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032262.366572:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835059712 00000100:00100000:3.0:1787032262.366600:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835059712 00002000:00010000:3.0:1787032262.366659:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1787032262.366664:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdff535500 with x1873838835059712 ext(0->18446744073709551615) 00002000:00010000:3.0:1787032262.366677:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdff535500. 00000100:00100000:3.0:1787032262.366711:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:3.0:1787032262.366722:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835059712:12345-192.168.201.48@tcp:10:bash.0 00002000:00010000:2.0:1787032262.367332:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787032262.367337:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787032258 -> 1787032261 00002000:00010000:2.0:1787032262.367349:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787032256 -> 1787032256 00002000:00010000:2.0:1787032262.367352:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787032258 -> 1787032261 00002000:00010000:2.0:1787032262.367353:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787032262.367418:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835059712:12345-192.168.201.48@tcp:10:bash.0 Request processed in 697us (954us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787032262.367432:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 5 00002000:00010000:2.0:1787032262.367436:0:6592:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787032262.367449:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdff535500 with x1873838835059712 ext(0->18446744073709551615) 00002000:00010000:2.0:1787032262.367455:0:6592:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdff535500. 00000100:00100000:1.0:1787032262.442562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032262.442645:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835059840 00000100:00100000:2.0:1787032262.442654:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835059840 00000100:00100000:2.0:1787032262.442718:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 194 00000100:00100000:2.0:1787032262.442727:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+32:11515:x1873838835059840:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:2.0:1787032262.442802:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.442835:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.442846:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.442861:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.442868:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.442873:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443212:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443221:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443227:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787032262.443264:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443276:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443282:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443299:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443305:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032262.443309:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443316:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443327:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032262.443331:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032262.443335:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443341:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea55f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443354:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443359:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443364:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443369:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032262.443372:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443388:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443396:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc3864300) 00010000:00010000:2.0:1787032262.443398:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032262.443401:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443407:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443422:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443428:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443433:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443438:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032262.443441:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443446:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443453:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:2.0:1787032262.443456:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032262.443458:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032262.443474:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea56d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032262.443553:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+32:11515:x1873838835059840:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 825us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032262.443561:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 194 00000001:00080000:1.0:1787032262.444421:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787032262.444446:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:0.0:1787032262.524878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032262.524986:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835060096 00000100:00100000:3.0:1787032262.524997:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835060096 00000100:00100000:3.0:1787032262.525163:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 195 00000100:00100000:3.0:1787032262.525174:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+32:11518:x1873838835060096:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032262.525196:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032262.525216:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a85 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.525332:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.525774:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.525786:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.525804:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.525811:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.525816:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.526217:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea589 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.526227:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.526234:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032262.526245:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787032262.527292:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527656:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527663:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527668:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032262.527672:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527679:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527693:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:3.0:1787032262.527696:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032262.527701:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527721:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea57b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527737:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527743:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527748:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527752:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032262.527755:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527760:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527768:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdcba3ab00) 00010000:00010000:3.0:1787032262.527771:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032262.527774:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527779:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527833:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a85 expref: 35 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527849:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a85 expref: 34 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.527864:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:3.0:1787032262.527866:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787032262.527869:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418a00, rc 0) 00000100:00100000:3.0:1787032262.528841:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+34:11518:x1873838835060096:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 3659us (3965us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787032262.528853:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 195 00000100:00100000:2.0:1787032262.539859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032262.541089:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835060224 00000100:00100000:3.0:1787032262.541102:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835060224 00000100:00100000:3.0:1787032262.541166:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 196 00000100:00100000:3.0:1787032262.541176:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+34:11518:x1873838835060224:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:3.0:1787032262.541248:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.541267:0:7755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 34 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.541277:0:7755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.541311:0:7755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 34 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.541325:0:7755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 34 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032262.541597:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857072128:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032262.541709:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded149780 going to sleep for 11 seconds 00000100:00100000:3.0:1787032262.555646:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857072128:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032262.555679:0:7755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032262.555764:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032262.556561:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835060480 00000100:00100000:0.0:1787032262.556571:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835060480 00000100:00100000:0.0:1787032262.556652:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00100000:0.0:1787032262.556662:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+35:5569:x1873838835060480:12345-192.168.201.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787032262.557217:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+36:5569:x1873838835060480:12345-192.168.201.48@tcp:35:ldlm_bl.0 Request processed in 554us (1451us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787032262.557225:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00100000:0.0:1787032262.573256:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032262.575027:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835060608 00000100:00100000:3.0:1787032262.575041:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835060608 00010000:00010000:3.0:1787032262.575139:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 36 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032262.575194:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 76 00000100:00100000:3.0:1787032262.575204:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+36:2354:x1873838835060608:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787032262.575219:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032262.575226:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 36 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.575238:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 36 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.575261:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea53c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a70 expref: 36 pid: 5798 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.575277:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:3.0:1787032262.575283:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.575292:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.575335:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.575366:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032262.575428:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+35:2354:x1873838835060608:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 224us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032262.575436:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 76 00010000:00010000:0.0:1787032262.580107:0:7755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.580125:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.580161:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.580168:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.580176:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.580207:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032262.580212:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.580220:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.580238:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:0.0:1787032262.580241:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787032262.580246:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.580252:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032262.580359:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+34:11518:x1873838835060224:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 39180us (40506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032262.580371:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 196 00000100:00100000:0.0:1787032262.583567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032262.583634:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835060864 00000100:00100000:1.0:1787032262.583646:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835060864 00000100:00100000:1.0:1787032262.583714:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:1.0:1787032262.583727:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+34:11518:x1873838835060864:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:1.0:1787032262.584000:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+35:11518:x1873838835060864:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 275us (445us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787032262.584008:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:2.0:1787032262.744693:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032262.745128:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835061120 00000100:00100000:0.0:1787032262.745139:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835061120 00000100:00100000:0.0:1787032262.745215:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 197 00000100:00100000:0.0:1787032262.745227:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+35:11529:x1873838835061120:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:0.0:1787032262.745256:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032262.745280:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea59e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a8c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745363:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745391:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745403:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745418:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745426:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745432:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745792:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745802:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745809:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032262.745820:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787032262.745916:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745925:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745932:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745946:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032262.745950:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745957:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745970:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032262.745973:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032262.745977:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745984:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.745996:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746016:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746022:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746027:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032262.746030:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746035:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746053:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc4f0a900) 00010000:00010000:0.0:1787032262.746055:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032262.746058:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746064:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746173:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea59e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a8c expref: 38 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746187:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a8c expref: 37 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.746194:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:0.0:1787032262.746197:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032262.746199:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537c00, rc 0) 00000100:00100000:0.0:1787032262.746268:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+37:11529:x1873838835061120:12345-192.168.201.48@tcp:101:cat.0 Request processed in 1044us (1586us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787032262.746276:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 197 00000100:00100000:3.0:1787032262.752533:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032262.755454:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835061376 00000100:00100000:1.0:1787032262.755474:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835061376 00000100:00100000:1.0:1787032262.755565:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 54 00000100:00100000:1.0:1787032262.755575:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+37:11529:x1873838835061376:12345-192.168.201.48@tcp:35:cat.0 00000100:00100000:1.0:1787032262.755861:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+38:11529:x1873838835061376:12345-192.168.201.48@tcp:35:cat.0 Request processed in 287us (3339us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787032262.755871:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 54 00000100:00100000:2.0:1787032262.788546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032262.788646:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835061632 00000100:00100000:1.0:1787032262.788656:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835061632 00000100:00100000:1.0:1787032262.788716:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 198 00000100:00100000:1.0:1787032262.788725:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+38:11530:x1873838835061632:12345-192.168.201.48@tcp:36:rm.0 00010000:00010000:1.0:1787032262.788779:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787032262.788806:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a8c expref: 38 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.788828:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea589 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a85 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.788861:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea551 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a77 expref: 36 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.788871:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ff100) 00010000:00010000:1.0:1787032262.788881:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032262.788903:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.788917:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.788926:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.788940:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.788946:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.788967:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.789333:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.789342:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.789349:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787032262.789950:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1787032262.789960:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417635891818ns, next at 418635889462ns, rc = 0 00010000:00010000:1.0:1787032262.790012:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790021:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790029:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790036:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790042:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790048:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790099:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787032262.790118:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790125:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790131:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790137:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032262.790143:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032262.790148:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.790152:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790159:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.790163:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032262.790174:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:1.0:1787032262.790178:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787032262.790182:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790183:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790196:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea5cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790212:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790217:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790222:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790227:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032262.790230:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790235:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790241:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:1.0:1787032262.790243:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032262.790251:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.790259:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea5c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032262.790268:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d1fbde7 reply state 000000002290d67f transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.790275:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032262.790279:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787032262.790291:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99cdce1ffc00) 00010000:00010000:0.0:1787032262.790294:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787032262.790298:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.790304:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea5d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.790322:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032262.790323:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032262.790326:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032262.790372:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+37:11530:x1873838835061632:12345-192.168.201.48@tcp:36:rm.0 Request processed in 1646us (1834us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787032262.790380:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 198 00010000:00010000:1.0:1787032262.796659:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.796678:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.796686:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.796693:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032262.796698:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.796705:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.796723:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032262.796727:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032262.796732:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.796753:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea5c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032262.859216:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032262.859419:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835061888 00000100:00100000:0.0:1787032262.859435:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835061888 00000100:00100000:0.0:1787032262.859520:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 199 00000100:00100000:0.0:1787032262.859531:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+36:11537:x1873838835061888:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032262.859558:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032262.859594:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a93 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.859767:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.859783:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.859795:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.859843:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.859852:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.859858:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787032262.862848:0:5799:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787032262.865745:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865771:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865785:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865837:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865845:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865852:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865858:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032262.865862:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865891:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865905:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032262.865909:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032262.865913:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.865918:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea5e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787032262.865937:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1a0f175 reply state 000000000571badb transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032262.865948:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787032262.865989:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea5dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 39 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.866007:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 38 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.866016:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0aa00) 00010000:00010000:0.0:1787032262.866018:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032262.866021:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537c00, rc 0) 00000100:00100000:0.0:1787032262.866161:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+39:11537:x1873838835061888:12345-192.168.201.48@tcp:101:bash.0 Request processed in 6630us (6960us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787032262.866171:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 199 00010000:00010000:3.0:1787032262.868919:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.868941:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.868951:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.868959:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032262.868966:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.868975:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.868996:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc4f0a900) 00010000:00010000:3.0:1787032262.869009:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032262.869015:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032262.869027:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea5eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032262.872852:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032262.876209:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835062016 00000100:00100000:0.0:1787032262.876241:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835062016 00000100:00100000:0.0:1787032262.876302:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:0.0:1787032262.876311:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838835062016:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032262.876329:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032262.876347:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2a9a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787032262.876374:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032262.876391:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1787032262.876396:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032262.876404:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.876423:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.876436:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537000, rc 0) 00000100:00100000:0.0:1787032262.876498:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2357:x1873838835062016:12345-192.168.201.48@tcp:101:bash.0 Request processed in 187us (3661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032262.876505:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:2.0:1787032262.886441:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032262.889151:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835062144 00000100:00100000:0.0:1787032262.889177:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835062144 00000100:00100000:0.0:1787032262.889262:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00100000:0.0:1787032262.889272:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+6:11537:x1873838835062144:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032262.889290:0:6586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032262.889309:0:6586:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2aa1 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.889357:0:6586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.889367:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032262.889372:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032262.889377:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.889412:0:6586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.889426:0:6586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 7 pid: 6587 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032262.889440:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1873838857072256:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032262.889549:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d42600 going to sleep for 11 seconds 00000100:00100000:0.0:1787032262.893471:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6586:1873838857072256:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032262.893514:0:6586:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 7 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032262.893540:0:6586:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536000, rc 0) 00000100:00100000:0.0:1787032262.896418:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:11537:x1873838835062144:12345-192.168.201.48@tcp:101:bash.0 Request processed in 7132us (9978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032262.896434:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00100000:3.0:1787032262.908590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032262.908902:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835062272 00000100:00100000:1.0:1787032262.908915:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835062272 00010000:00010000:1.0:1787032262.908981:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 7 pid: 6587 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032262.909039:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 77 00000100:00100000:1.0:1787032262.909050:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835062272:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032262.909104:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032262.909134:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 7 pid: 6587 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.909151:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 7 pid: 6587 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.909191:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1ea600 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a9a expref: 7 pid: 6587 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.909213:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032262.909219:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032262.909229:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.909241:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032262.909309:0:5784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032262.909326:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5784:1873838857072384:192.168.201.48@tcp:105: 00000100:00100000:1.0:1787032262.909435:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc33c3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032262.924682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032262.924778:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835062528 00000100:00100000:0.0:1787032262.924786:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835062528 00000100:00100000:0.0:1787032262.924850:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 55 00000100:00100000:0.0:1787032262.924859:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+38:11537:x1873838835062528:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:3.0:1787032262.925528:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+39:11537:x1873838835062528:12345-192.168.201.48@tcp:35:bash.0 Request processed in 665us (852us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787032262.925538:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 55 00000100:00100000:1.0:1787032262.927624:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5784:1873838857072384:192.168.201.48@tcp:105: 00010000:00010000:1.0:1787032262.927655:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032262.927721:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2354:x1873838835062272:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 18671us (19155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032262.927732:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 77 00000100:00100000:2.0:1787032263.086388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.086482:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835062656 00000100:00100000:0.0:1787032263.086492:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835062656 00000100:00100000:0.0:1787032263.086558:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 200 00000100:00100000:0.0:1787032263.086568:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+39:11553:x1873838835062656:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032263.086619:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032263.086640:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea60e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2aa8 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.086703:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea615 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.086718:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.086730:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032263.086790:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787032263.086794:0:7755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032263.086817:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea615 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.086844:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea60e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa8 expref: 41 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.086864:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea615 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa8 expref: 40 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.086888:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032263.086891:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787032263.086895:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537000, rc 0) 00000100:00100000:0.0:1787032263.086967:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+40:11553:x1873838835062656:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 400us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.086975:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 200 00000100:00100000:2.0:1787032263.096390:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.096479:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835062912 00000100:00100000:3.0:1787032263.096490:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835062912 00000100:00100000:3.0:1787032263.096554:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 201 00000100:00100000:3.0:1787032263.096564:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+40:11553:x1873838835062912:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032263.096593:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032263.096619:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea61c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2aaf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.096725:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.096740:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.096751:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032263.096763:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787032263.096893:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea61c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aaf expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.096912:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aaf expref: 42 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.096942:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0aa00) 00010000:00010000:3.0:1787032263.096945:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032263.096948:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419a00, rc 0) 00000100:00100000:3.0:1787032263.097267:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+42:11553:x1873838835062912:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 703us (885us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787032263.097275:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 201 00000100:00100000:3.0:1787032263.103368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.103416:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.103513:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835063296 00000100:00100000:0.0:1787032263.103523:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835063296 00000100:00100000:0.0:1787032263.103599:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 202 00000100:00100000:0.0:1787032263.103610:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+42:11553:x1873838835063296:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032263.103636:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032263.103658:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2ab6 expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.103761:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea638 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.103776:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.103788:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032263.103801:0:7755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787032263.103954:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ab6 expref: 45 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.103997:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ab6 expref: 44 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.104006:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0aa00) 00010000:00010000:0.0:1787032263.104010:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787032263.104025:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536400, rc 0) 00000100:00100000:0.0:1787032263.104146:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+44:11553:x1873838835063296:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 537us (728us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787032263.104154:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 202 00000100:00100000:1.0:1787032263.104752:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835063040 00000100:00100000:1.0:1787032263.104758:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835063040 00000100:00100000:1.0:1787032263.104819:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:1.0:1787032263.104828:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+44:2357:x1873838835063040:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.104857:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.104878:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aaf expref: 44 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.104894:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0aa00) 00010000:00010000:1.0:1787032263.104899:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032263.104940:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+43:2357:x1873838835063040:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 113us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.104948:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:3.0:1787032263.114635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.114728:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835063424 00000100:00100000:0.0:1787032263.114738:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835063424 00000100:00100000:0.0:1787032263.114823:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 62 00000100:00100000:0.0:1787032263.114834:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+6:2355:x1873838835063424:12345-192.168.201.48@tcp:1:lfs.0 00010000:00010000:0.0:1787032263.114889:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.114913:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.114923:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032263.114928:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032263.114933:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.114973:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 6 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.115001:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 6 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.115029:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6587:1873838857072512:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032263.115158:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc4d200c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787032263.115587:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032263.118342:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.118435:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835063552 00000100:00100000:1.0:1787032263.118459:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835063552 00002000:00100000:1.0:1787032263.118511:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99cdffec5180 x1873838835063552/t0(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:124/0 lens 504/0 e 0 to 0 dl 1787032274 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032263.118522:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdffec5180 with x1873838835063552 ext(0->8) 00010000:00010000:1.0:1787032263.118531:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 7 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.118548:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 7 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787032263.118557:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99cdffec5180 00000100:00100000:1.0:1787032263.118598:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:1.0:1787032263.118609:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835063552:12345-192.168.201.48@tcp:4:lfs.0 00000100:00100000:0.0:1787032263.118731:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4887b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6587:1873838857072512:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032263.118758:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.119196:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835063552:12345-192.168.201.48@tcp:4:lfs.0 Request processed in 587us (862us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787032263.119205:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 3 00002000:00100000:1.0:1787032263.119213:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99cdffec5180 x1873838835063552/t4294967308(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:124/0 lens 504/448 e 0 to 0 dl 1787032274 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032263.119221:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdffec5180 with x1873838835063552 ext(0->8) 00010000:00010000:1.0:1787032263.119227:0:6590:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 9 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.119238:0:6590:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 9 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787032263.119245:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99cdffec5180 00000100:00100000:2.0:1787032263.122258:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.124426:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835063680 00000100:00100000:0.0:1787032263.124442:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835063680 00010000:00010000:0.0:1787032263.124492:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 9 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.124533:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 78 00000100:00100000:0.0:1787032263.124542:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+9:2354:x1873838835063680:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032263.124561:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787032263.124592:0:11533:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787032263.124595:0:11533:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787032262 00002000:00010000:0.0:1787032263.124597:0:11533:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787032262 00002000:00010000:0.0:1787032263.124599:0:11533:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787032262 00010000:00010000:0.0:1787032263.124605:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 9 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.124640:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 9 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.124666:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa60097b/0xcd047797ef1ea607 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa1 expref: 9 pid: 6586 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.124683:0:11533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032263.124688:0:11533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787032263.124695:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.124705:0:11533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.124745:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032263.124786:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.124799:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.124822:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835063680:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 280us (2576us total) trans 0 rc 0/0 00010000:00010000:2.0:1787032263.124827:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.124833:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 78 00010000:00010000:2.0:1787032263.124842:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.124859:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.124867:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032263.124871:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.124881:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.124893:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.124901:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6149f41/0xcd047797ef1ea646 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.124951:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+7:2355:x1873838835063424:12345-192.168.201.48@tcp:1:lfs.0 Request processed in 10118us (10327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.124960:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 62 00000100:00100000:3.0:1787032263.127661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.127764:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835063936 00000100:00100000:1.0:1787032263.127774:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835063936 00000100:00100000:1.0:1787032263.127826:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 56 00000100:00100000:1.0:1787032263.127834:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+43:11553:x1873838835063936:12345-192.168.201.48@tcp:35:lfs.0 00000004:00010000:1.0:1787032263.127902:0:5801:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ab6 expref: 43 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787032263.128257:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787032263.128285:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787032263.128551:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787032263.128609:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.128625:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 47 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.128634:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.128670:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 47 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.128682:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 47 pid: 5799 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.128692:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1873838857072640:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032263.128762:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b1ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032263.130393:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5801:1873838857072640:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032263.130437:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.130855:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.130934:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835064064 00000100:00100000:1.0:1787032263.130941:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835064064 00010000:00010000:1.0:1787032263.130978:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 48 pid: 5799 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.131134:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 79 00000100:00100000:1.0:1787032263.131145:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+48:2355:x1873838835064064:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.131162:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.131170:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 48 pid: 5799 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.131182:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 48 pid: 5799 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.131205:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea5f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a93 expref: 48 pid: 5799 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.131222:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0aa00) 00010000:00010000:1.0:1787032263.131227:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.131236:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.131245:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.131289:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032263.131345:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+47:2355:x1873838835064064:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 201us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.131352:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 79 00010000:00010000:3.0:1787032263.131770:0:5801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.131778:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787032263.131929:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787032263.132207:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787032263.132328:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857072768:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787032263.132393:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.132420:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded149240 going to sleep for 11 seconds 00000100:00100000:2.0:1787032263.132641:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857072768 00000100:00100000:2.0:1787032263.132647:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857072768 00000100:00100000:2.0:1787032263.132702:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787032263.132709:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857072768:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787032263.132782:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857072768:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.132809:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787032263.133372:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032263.133424:0:5801:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1787032263.133431:0:5801:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1787032263.133449:0:5801:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cdff65ce00, transno 4294967307 00000100:00100000:3.0:1787032263.133474:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857072768:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787032263.133945:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787032263.134483:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857072896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787032263.134565:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.134615:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cded149780 going to sleep for 11 seconds 00000100:00100000:0.0:1787032263.134933:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857072896 00000100:00100000:0.0:1787032263.134939:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857072896 00000100:00100000:0.0:1787032263.134980:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787032263.134986:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5801:x1873838857072896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787032263.135277:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5801:x1873838857072896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 291us (712us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787032263.135283:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787032263.135490:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5801:1873838857072896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787032263.135553:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787032263.135614:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.135623:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.135629:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.135633:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032263.135637:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.135642:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.135655:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0aa00) 00010000:00010000:3.0:1787032263.135657:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787032263.135660:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.135664:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775e00/0xcd047797ef1ea64d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787032263.135826:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787032263.135902:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1787032263.135910:0:5801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417981841307ns, next at 418981839970ns, rc = 0 00000001:00080000:3.0:1787032263.135914:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787032263.135935:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0aa00) 00010000:00010000:3.0:1787032263.135937:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787032263.135943:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea638 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ab6 expref: 51 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.136139:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+50:11553:x1873838835063936:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 8300us (8483us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787032263.136149:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 56 00000020:00080000:3.0:1787032263.136153:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787032263.142666:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.142780:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835064192 00000100:00100000:0.0:1787032263.142792:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835064192 00000100:00100000:0.0:1787032263.142855:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 203 00000100:00100000:0.0:1787032263.142865:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+50:11553:x1873838835064192:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032263.142904:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032263.142931:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea654 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2abd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.143001:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2abd expref: 51 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.143180:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2abd expref: 51 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.143208:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:0.0:1787032263.143212:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032263.143215:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0031600, rc 0) 00000100:00100000:0.0:1787032263.143280:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+51:11553:x1873838835064192:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 415us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.143287:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 203 00000100:00100000:2.0:1787032263.147432:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.148479:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835064448 00000100:00100000:3.0:1787032263.148493:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835064448 00000100:00100000:2.0:1787032263.148693:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 57 00000100:00100000:2.0:1787032263.148704:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+51:11553:x1873838835064448:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:2.0:1787032263.149017:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+52:11553:x1873838835064448:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 304us (1587us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787032263.149026:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 57 00000100:00100000:2.0:1787032263.239371:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.239438:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835064576 00000100:00100000:0.0:1787032263.239450:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835064576 00000100:00100000:0.0:1787032263.239562:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 204 00000100:00100000:0.0:1787032263.239583:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+52:11563:x1873838835064576:12345-192.168.201.48@tcp:34:lfs.0 00010000:00010000:0.0:1787032263.239675:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239693:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239721:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239738:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239746:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239752:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239856:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239865:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239873:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787032263.239918:0:7755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239931:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239938:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239945:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239965:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032263.239969:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239977:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.239990:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032263.239993:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032263.239998:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240004:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea65b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240266:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240273:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240279:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240285:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032263.240288:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240294:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240314:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc4f0ad00) 00010000:00010000:0.0:1787032263.240317:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032263.240320:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240327:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240342:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240348:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240354:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240359:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032263.240362:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240369:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240376:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:0.0:1787032263.240378:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032263.240381:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.240388:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.240470:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+52:11563:x1873838835064576:12345-192.168.201.48@tcp:34:lfs.0 Request processed in 898us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.240479:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 204 00000100:00100000:0.0:1787032263.270541:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.270803:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835064832 00000100:00100000:2.0:1787032263.270816:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835064832 00000100:00100000:2.0:1787032263.270885:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 205 00000100:00100000:2.0:1787032263.270895:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+52:11566:x1873838835064832:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032263.270923:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032263.270946:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea670 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2ac4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271041:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271057:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271107:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271124:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271150:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271164:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271298:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271306:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271312:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032263.271322:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787032263.271434:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271443:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271449:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271455:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.271460:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271467:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271493:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032263.271496:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032263.271500:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271506:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271522:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271529:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271534:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271538:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.271541:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271546:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271553:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc3864300) 00010000:00010000:2.0:1787032263.271555:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032263.271558:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271564:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea67e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271630:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea670 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 55 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271643:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 54 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.271651:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032263.271653:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032263.271655:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6200, rc 0) 00000100:00100000:2.0:1787032263.271724:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+54:11566:x1873838835064832:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 831us (1194us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787032263.271732:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 205 00000100:00100000:2.0:1787032263.274979:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.275134:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835064960 00000100:00100000:1.0:1787032263.275145:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835064960 00000100:00100000:1.0:1787032263.275214:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 206 00000100:00100000:1.0:1787032263.275222:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+54:11566:x1873838835064960:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:1.0:1787032263.275279:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275292:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275300:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275323:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275328:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275332:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275336:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032263.275339:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275360:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275370:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032263.275372:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787032263.275375:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.275379:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.275455:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+54:11566:x1873838835064960:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 232us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.275462:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 206 00000100:00100000:0.0:1787032263.278148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.278325:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835065216 00000100:00100000:3.0:1787032263.278335:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835065216 00000100:00100000:3.0:1787032263.278389:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 58 00000100:00100000:3.0:1787032263.278398:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+54:11566:x1873838835065216:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032263.278650:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+55:11566:x1873838835065216:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 252us (511us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787032263.278656:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 58 00010000:00010000:2.0:1787032263.365363:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032263.373650:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.374200:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835065472 00000100:00100000:2.0:1787032263.374213:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835065472 00000100:00100000:2.0:1787032263.374278:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 207 00000100:00100000:2.0:1787032263.374287:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+55:11576:x1873838835065472:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:2.0:1787032263.374314:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032263.374318:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787032263.374344:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537000/0xcd047797ef1ea615 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aa8 expref: 55 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.374366:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032263.374371:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032263.374387:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea69a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2acb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.374527:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.374543:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 55 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.374552:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.374598:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 55 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.374614:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 55 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.374630:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffec6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857073024:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032263.374745:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787032263.379922:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffec6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857073024:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032263.379965:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.381984:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.382350:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835065600 00000100:00100000:0.0:1787032263.382360:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835065600 00010000:00010000:0.0:1787032263.382401:0:11533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 56 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.382453:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 80 00000100:00100000:0.0:1787032263.382463:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff656300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+56:2355:x1873838835065600:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032263.382480:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032263.382618:0:11533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 56 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.382633:0:11533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 56 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.382655:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ac4 expref: 56 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.382671:0:11533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:0.0:1787032263.382749:0:11533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.382759:0:11533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.382779:0:11533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.382871:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032263.382933:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff656300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d144536-0f5d-43dc-8f25-f68546215872+55:2355:x1873838835065600:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 471us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.382943:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 80 00010000:00010000:2.0:1787032263.383376:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.383385:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032263.383405:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787032263.383599:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea69a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 56 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.383617:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 55 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.383625:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032263.383628:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787032263.383631:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032263.383684:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+55:11576:x1873838835065472:12345-192.168.201.48@tcp:101:bash.0 Request processed in 9385us (10032us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787032263.383691:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 207 00000100:00100000:3.0:1787032263.390380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.393245:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835065856 00000100:00100000:1.0:1787032263.393262:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835065856 00000100:00100000:1.0:1787032263.393345:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 208 00000100:00100000:1.0:1787032263.393356:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+55:11576:x1873838835065856:12345-192.168.201.48@tcp:36:bash.0 00010000:00010000:1.0:1787032263.393653:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.393671:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.393693:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787032263.393747:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787032263.393770:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003dac196d reply state 000000008a5652dc transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.393791:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787032263.393897:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+58:11576:x1873838835065856:12345-192.168.201.48@tcp:36:bash.0 Request processed in 541us (3527us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787032263.393904:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 208 00000020:00080000:1.0:1787032263.393909:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787032263.400896:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.400914:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.400921:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.400926:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032263.400931:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.400938:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.400956:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032263.400959:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032263.400963:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.400970:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea6af lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.401701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.402141:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835065984 00000100:00100000:3.0:1787032263.402154:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835065984 00000100:00100000:3.0:1787032263.402216:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 209 00000100:00100000:3.0:1787032263.402225:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+57:11576:x1873838835065984:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:3.0:1787032263.402253:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032263.402275:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea6b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2ad2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.402364:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.402378:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 58 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.402386:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.402430:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 58 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.402443:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 58 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.402457:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff656d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857073152:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032263.402538:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc6115000 going to sleep for 11 seconds 00000100:00100000:3.0:1787032263.406712:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff656d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857073152:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032263.406755:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.407460:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.407578:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835066112 00000100:00100000:1.0:1787032263.407595:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835066112 00010000:00010000:1.0:1787032263.407638:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 59 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.407689:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 81 00000100:00100000:1.0:1787032263.407699:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+59:2355:x1873838835066112:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.407717:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.407726:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 59 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.407738:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 59 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.407764:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2acb expref: 59 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.407782:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032263.407789:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.407811:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.407821:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.407857:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032263.408023:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.408032:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032263.408128:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787032263.408135:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032263.408178:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.408228:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea6b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.408246:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 58 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.408254:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:0.0:1787032263.408257:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032263.408259:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419600, rc 0) 00000100:00100000:1.0:1787032263.408353:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+58:2355:x1873838835066112:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 652us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.408371:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 81 00000100:00100000:0.0:1787032263.408730:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+57:11576:x1873838835065984:12345-192.168.201.48@tcp:101:bash.0 Request processed in 6503us (7034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.408739:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 209 00000100:00100000:1.0:1787032263.426811:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.427304:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835066368 00000100:00100000:3.0:1787032263.427317:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835066368 00000100:00100000:3.0:1787032263.427381:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 59 00000100:00100000:3.0:1787032263.427390:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+57:11576:x1873838835066368:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:3.0:1787032263.427687:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+58:11576:x1873838835066368:12345-192.168.201.48@tcp:35:bash.0 Request processed in 296us (885us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787032263.427695:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 59 00000100:00100000:3.0:1787032263.436554:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857073664:0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.436641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.436690:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787032263.436697:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857073280:0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.436725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.436753:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857073792:0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.436775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.436802:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857073408:0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.436823:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.436841:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857073920:0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.436864:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.436880:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032263.436885:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857073536:0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.436905:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.436929:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857073280 00000100:00100000:3.0:1787032263.436937:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857073280 00000100:00100000:3.0:1787032263.436984:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787032263.437013:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857073280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.437100:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857073280:12345-0@lo:400:kworker.0 Request processed in 89us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032263.437108:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787032263.437234:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857073280:0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.437262:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857073664 00000100:00100000:3.0:1787032263.437266:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857073664 00000100:00100000:3.0:1787032263.437293:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857073920 00000100:00100000:3.0:1787032263.437295:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857073920 00000100:00100000:3.0:1787032263.437321:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787032263.437327:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1873838857073664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.437360:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1873838857073664:12345-0@lo:400:kworker.0 Request processed in 34us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032263.437366:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787032263.437376:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787032263.437382:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857073920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032263.437412:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857073920:12345-0@lo:400:kworker.0 Request processed in 30us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032263.437417:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787032263.438129:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857073792 00000100:00100000:2.0:1787032263.438135:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857073792 00000100:00100000:2.0:1787032263.438183:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857073408 00000100:00100000:2.0:1787032263.438187:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857073408 00000100:00100000:2.0:1787032263.438200:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857073536 00000100:00100000:2.0:1787032263.438202:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857073536 00000100:00100000:2.0:1787032263.438241:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787032263.438248:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857073792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032263.438297:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857073792:12345-0@lo:400:kworker.0 Request processed in 49us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.438304:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787032263.438321:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787032263.438327:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857073408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032263.438354:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857073408:12345-0@lo:400:kworker.0 Request processed in 28us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.438360:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787032263.438380:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787032263.438386:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857073536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032263.438439:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857073536:12345-0@lo:400:kworker.0 Request processed in 53us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.438446:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787032263.438520:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857073792:0@lo:400:kworker.0 00000100:00100000:2.0:1787032263.438535:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857073664:0@lo:400:kworker.0 00000100:00080000:2.0:1787032263.438557:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787032263.438562:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032263.438595:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857073536:0@lo:400:kworker.0 00000100:00100000:2.0:1787032263.438605:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857073408:0@lo:400:kworker.0 00000100:00100000:2.0:1787032263.438614:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857073920:0@lo:400:kworker.0 00000100:00100000:1.0:1787032263.544370:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.544559:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835066496 00000100:00100000:2.0:1787032263.544579:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835066496 00000100:00100000:2.0:1787032263.544661:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 210 00000100:00100000:2.0:1787032263.544673:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+58:11582:x1873838835066496:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032263.544701:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032263.544726:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea6c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2ad9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.544812:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea6cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.544827:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.544858:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032263.544931:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787032263.544936:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032263.544962:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.544988:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea6c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad9 expref: 60 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.545020:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad9 expref: 59 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.545029:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032263.545033:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032263.545037:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6600, rc 0) 00000100:00100000:2.0:1787032263.545400:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+59:11582:x1873838835066496:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 726us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.545408:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 210 00000100:00100000:3.0:1787032263.549881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.549964:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835066624 00000100:00100000:2.0:1787032263.549976:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835066624 00000100:00100000:2.0:1787032263.550063:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 211 00000100:00100000:2.0:1787032263.550103:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+59:11582:x1873838835066624:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032263.550128:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032263.550161:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2ae0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550254:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550269:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550281:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550296:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550303:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550310:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550410:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea6e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550702:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550713:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032263.550748:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787032263.550752:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032263.550770:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550803:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550812:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550819:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550826:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550831:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.550835:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550842:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550855:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032263.550858:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032263.550863:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550869:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea6d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550883:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550889:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550901:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550906:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.550909:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550915:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550923:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc3864300) 00010000:00010000:2.0:1787032263.550925:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032263.550928:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550934:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea6e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550975:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1ea6d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae0 expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550990:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae0 expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.550997:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032263.550999:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032263.551002:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7c00, rc 0) 00000100:00100000:2.0:1787032263.552032:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+60:11582:x1873838835066624:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1926us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.552058:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 211 00000100:00100000:3.0:1787032263.560805:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.560898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.561578:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835067008 00000100:00100000:1.0:1787032263.561590:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835067008 00000100:00100000:1.0:1787032263.561664:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:1.0:1787032263.561674:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+60:2357:x1873838835067008:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.561690:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.561718:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ea6e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae0 expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.561737:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032263.561743:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032263.561807:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+59:2357:x1873838835067008:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 134us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.561814:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:2.0:1787032263.562991:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835066880 00000100:00100000:2.0:1787032263.563013:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835066880 00000100:00100000:2.0:1787032263.563064:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 212 00000100:00100000:2.0:1787032263.563096:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+59:11582:x1873838835066880:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032263.563114:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032263.563132:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea6ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2ae7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.563237:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.563253:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.563261:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.563297:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.563312:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 60 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.563327:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffec6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857074048:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032263.563402:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787032263.571845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.571944:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffec6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857074048:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032263.571982:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.572924:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835067136 00000100:00100000:0.0:1787032263.572944:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835067136 00010000:00010000:0.0:1787032263.572987:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 61 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.573029:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 82 00000100:00100000:0.0:1787032263.573038:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+61:2355:x1873838835067136:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032263.573054:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032263.573061:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 61 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.573242:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 61 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.573268:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1ea6bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad2 expref: 61 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.573285:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:0.0:1787032263.573290:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.573299:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.573306:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.573345:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032263.573461:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+60:2355:x1873838835067136:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 424us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.573470:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 82 00010000:00010000:3.0:1787032263.574742:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.574756:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032263.574790:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787032263.574972:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1ea6ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 61 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.574992:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 60 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.575000:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032263.575002:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787032263.575005:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6e00, rc 0) 00000100:00100000:3.0:1787032263.575051:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+60:11582:x1873838835066880:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 11956us (14273us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787032263.575059:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 212 00000100:00100000:0.0:1787032263.580518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.580594:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835067392 00000100:00100000:1.0:1787032263.580604:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835067392 00000100:00100000:1.0:1787032263.580678:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:1.0:1787032263.580688:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+60:11582:x1873838835067392:12345-192.168.201.48@tcp:103:lfs.0 00010000:00010000:1.0:1787032263.580706:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.580734:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea654 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2abd expref: 60 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.580754:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032263.580774:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032263.580832:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+59:11582:x1873838835067392:12345-192.168.201.48@tcp:103:lfs.0 Request processed in 146us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.580839:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:1.0:1787032263.587262:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.587449:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835067520 00000100:00100000:0.0:1787032263.587459:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835067520 00000100:00100000:0.0:1787032263.587523:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 213 00000100:00100000:0.0:1787032263.587533:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+59:11582:x1873838835067520:12345-192.168.201.48@tcp:58:lfs.0 00010000:00010000:0.0:1787032263.587645:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.587664:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.587676:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787032263.587856:0:7755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787032263.588103:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+59:11582:x1873838835067520:12345-192.168.201.48@tcp:58:lfs.0 Request processed in 537us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.588111:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 213 00000100:00100000:0.0:1787032263.595372:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.595462:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835067648 00000100:00100000:1.0:1787032263.595473:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835067648 00000100:00100000:1.0:1787032263.595549:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 214 00000100:00100000:1.0:1787032263.595560:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+59:11582:x1873838835067648:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032263.595590:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032263.595614:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2aee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.595677:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.595689:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aee expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.595710:0:5798:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.595725:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aee expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.595739:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032263.595743:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787032263.595747:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aee expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.595772:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775c00, rc 0) 00000100:00100000:1.0:1787032263.595843:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+60:11582:x1873838835067648:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 285us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.595851:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 214 00000040:00080000:2.0:1787032263.617531:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787032263.617554:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787032263.617650:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787032263.617658:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787032263.617816:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffec6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857074176:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787032263.617929:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032263.624665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.624757:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffec6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857074176:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787032263.625102:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835067776 00000100:00100000:1.0:1787032263.625111:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835067776 00000100:00100000:1.0:1787032263.625171:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 215 00000100:00100000:1.0:1787032263.625180:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+60:11583:x1873838835067776:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787032263.625215:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787032263.625323:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+60:11583:x1873838835067776:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 144us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.625332:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 215 00000100:00100000:1.0:1787032263.629543:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.629667:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835067904 00000100:00100000:0.0:1787032263.629678:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835067904 00000100:00100000:3.0:1787032263.630300:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 216 00000100:00100000:3.0:1787032263.630316:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+60:11583:x1873838835067904:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787032263.630394:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630662:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630676:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630762:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630771:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630778:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630810:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630821:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630828:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032263.630875:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787032263.630881:0:5799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787032263.630897:0:5799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630912:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.630920:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631276:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631298:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032263.631304:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631313:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631327:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:3.0:1787032263.631331:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032263.631336:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631342:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea711 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631357:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631365:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631371:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631376:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032263.631379:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631385:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631405:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff99cdcba3ab00) 00010000:00010000:3.0:1787032263.631408:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032263.631411:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631494:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea718 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631516:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631524:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631530:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631535:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032263.631537:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631543:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631551:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032263.631553:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032263.631555:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.631560:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea71f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.631729:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+60:11583:x1873838835067904:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 Request processed in 1415us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032263.631739:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 216 00000100:00100000:2.0:1787032263.635303:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.635394:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835068160 00000100:00100000:1.0:1787032263.635405:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835068160 00000100:00100000:1.0:1787032263.635536:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 217 00000100:00100000:1.0:1787032263.635547:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+60:11583:x1873838835068160:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787032263.635577:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032263.635598:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea726 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2af5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635699:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635716:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635741:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032263.635754:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787032263.635856:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635864:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635870:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635875:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032263.635879:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635886:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635897:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032263.635900:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787032263.635904:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.635910:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775600/0xcd047797ef1ea72d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.636355:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea726 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2af5 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.636381:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:1.0:1787032263.636383:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787032263.636388:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774000/0xcd047797ef1ea726 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2af5 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.636398:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774000, rc 0) 00000100:00100000:1.0:1787032263.636590:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+61:11583:x1873838835068160:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 1044us (1296us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787032263.636598:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 217 00000100:00100000:0.0:1787032263.640713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.640811:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835068288 00000100:00100000:1.0:1787032263.640823:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835068288 00000100:00100000:1.0:1787032263.640915:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 218 00000100:00100000:1.0:1787032263.641378:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+61:11583:x1873838835068288:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787032263.641500:0:5798:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787032263.641674:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+61:11583:x1873838835068288:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 747us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.641682:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 218 00000100:00100000:0.0:1787032263.645746:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.646327:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835068544 00000100:00100000:2.0:1787032263.646339:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835068544 00000100:00100000:2.0:1787032263.646413:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 219 00000100:00100000:2.0:1787032263.646431:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+61:11583:x1873838835068544:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032263.646451:0:7755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032263.646454:0:7755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787032263.646485:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea6cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ad9 expref: 61 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.646506:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032263.646511:0:7755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032263.646525:0:7755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea73b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2afc expref: -99 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787032263.646975:0:7755:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787032263.647234:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.647247:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.647272:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.647336:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea73b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2afc expref: 63 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.647354:0:7755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2afc expref: 62 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.647362:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:2.0:1787032263.647365:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032263.647368:0:7755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6c00, rc 0) 00000100:00100000:2.0:1787032263.647441:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+62:11583:x1873838835068544:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 1012us (1708us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787032263.647449:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 219 00000100:00100000:2.0:1787032263.653358:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.653448:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835068800 00000100:00100000:3.0:1787032263.653458:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835068800 00000100:00100000:3.0:1787032263.653520:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 220 00000100:00100000:3.0:1787032263.653529:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+62:11583:x1873838835068800:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787032263.653600:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032263.653630:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6c00/0xcd047797ef1ea742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2afc expref: 62 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653651:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdc3864300) 00010000:00010000:3.0:1787032263.653661:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032263.653682:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653697:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653707:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653720:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653727:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653734:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653830:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653838:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653843:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653848:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032263.653852:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653859:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653868:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:3.0:1787032263.653871:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032263.653875:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653881:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1ea750 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653891:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653896:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653902:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653914:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032263.653917:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653923:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653931:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf7ab29d5 (ffff99cdcba3ab00) 00010000:00010000:3.0:1787032263.653933:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032263.653936:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.653942:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea757 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf7ab29d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.654039:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+61:11583:x1873838835068800:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 510us (692us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787032263.654046:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 220 00000100:00100000:0.0:1787032263.656981:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.657135:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835068928 00000100:00100000:3.0:1787032263.657145:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835068928 00000100:00100000:3.0:1787032263.657260:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 221 00000100:00100000:3.0:1787032263.657270:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+61:11583:x1873838835068928:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032263.657294:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032263.657319:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea75e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b03 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.657351:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.657378:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.657388:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.657491:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ea75e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 63 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.657509:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.657517:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:3.0:1787032263.657519:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787032263.657523:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419400, rc 0) 00000100:00100000:3.0:1787032263.657594:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+62:11583:x1873838835068928:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 326us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032263.657602:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 221 00000100:00100000:0.0:1787032263.661841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.661935:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835069184 00000100:00100000:3.0:1787032263.661945:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835069184 00000100:00100000:2.0:1787032263.662370:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 222 00000100:00100000:2.0:1787032263.662381:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+62:11583:x1873838835069184:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787032263.662474:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.662493:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.662505:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787032263.662798:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1787032263.662892:0:5799:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064f8d26f reply state 000000007b621603 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.662902:0:5799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787032263.667086:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+64:11583:x1873838835069184:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 4679us (5226us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787032263.667101:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 222 00000100:00100000:1.0:1787032263.670811:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.670904:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835069312 00000100:00100000:0.0:1787032263.670921:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835069312 00000100:00100000:0.0:1787032263.670992:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 223 00000100:00100000:0.0:1787032263.671012:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+64:11583:x1873838835069312:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032263.671037:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032263.671059:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b0a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.671148:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 65 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.671266:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 65 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.671289:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:0.0:1787032263.671293:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032263.671298:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0031600, rc 0) 00000100:00100000:0.0:1787032263.671379:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+65:11583:x1873838835069312:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 377us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.671387:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 223 00010000:00010000:3.0:1787032263.675262:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.675281:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.675288:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.675315:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032263.675320:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.675328:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.675346:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:3.0:1787032263.675349:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787032263.675354:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.675360:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea76c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.675725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.675856:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835069440 00000100:00100000:3.0:1787032263.675867:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835069440 00000100:00100000:3.0:1787032263.675923:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:3.0:1787032263.675933:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:2355:x1873838835069440:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787032263.676452:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d144536-0f5d-43dc-8f25-f68546215872+10:2355:x1873838835069440:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 519us (731us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787032263.676460:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:2.0:1787032263.678952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.679042:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835069696 00000100:00100000:3.0:1787032263.679054:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835069696 00000100:00100000:3.0:1787032263.679133:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:3.0:1787032263.679143:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+64:11583:x1873838835069696:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787032263.679391:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+65:11583:x1873838835069696:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 249us (449us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787032263.679412:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 60 00000100:00100000:2.0:1787032263.681549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.681675:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835069952 00000100:00100000:3.0:1787032263.681683:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835069952 00000100:00100000:3.0:1787032263.681734:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 224 00000100:00100000:3.0:1787032263.681743:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+65:11583:x1873838835069952:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787032263.681844:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+65:11583:x1873838835069952:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032263.681851:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 224 00000100:00100000:2.0:1787032263.684668:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.684764:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835070080 00000100:00100000:0.0:1787032263.684774:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835070080 00000100:00100000:0.0:1787032263.684873:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 225 00000100:00100000:0.0:1787032263.684886:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+65:11583:x1873838835070080:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032263.684908:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032263.684949:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea77a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b11 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.685039:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.685053:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.685098:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032263.685136:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032263.685164:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.685190:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1ea77a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b11 expref: 67 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.685207:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b11 expref: 66 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.685214:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:0.0:1787032263.685217:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787032263.685220:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030000, rc 0) 00000100:00100000:0.0:1787032263.685275:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+66:11583:x1873838835070080:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 392us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.685282:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 225 00000100:00100000:2.0:1787032263.688142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.688294:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835070208 00000100:00100000:3.0:1787032263.688303:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835070208 00000100:00100000:3.0:1787032263.688354:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 64 00000100:00100000:3.0:1787032263.688365:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+10:2354:x1873838835070208:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032263.688384:0:6895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032263.688402:0:6895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b18 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787032263.688432:0:6895:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a83f2c7, blocks: 0x1 00010000:00010000:3.0:1787032263.688452:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1787032263.688456:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032263.688466:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 11 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.688483:0:6895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 11 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.688515:0:6895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418800, rc 0) 00000100:00100000:3.0:1787032263.688577:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+11:2354:x1873838835070208:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 202us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032263.688585:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 64 00000100:00100000:2.0:1787032263.691127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.691795:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835070464 00000100:00100000:1.0:1787032263.691806:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835070464 00000100:00100000:1.0:1787032263.691871:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 226 00000100:00100000:1.0:1787032263.691882:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+66:11583:x1873838835070464:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787032263.691985:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+66:11583:x1873838835070464:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 105us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.692020:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 226 00000100:00100000:2.0:1787032263.694678:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.694743:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835070592 00000100:00100000:1.0:1787032263.694753:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835070592 00000100:00100000:1.0:1787032263.694800:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 65 00000100:00100000:1.0:1787032263.694809:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+11:11583:x1873838835070592:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787032263.694824:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032263.694841:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b1f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.694875:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 12 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.694885:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032263.694890:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032263.694895:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.694926:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 12 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.694938:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 12 pid: 6895 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.694951:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6584:1873838857074304:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032263.695026:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b1a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787032263.698606:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.698715:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6584:1873838857074304:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032263.698752:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.698773:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775600, rc 0) 00000100:00100000:1.0:1787032263.698838:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+12:11583:x1873838835070592:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 4029us (4170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.698847:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 65 00000100:00100000:3.0:1787032263.700450:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835070720 00000100:00100000:3.0:1787032263.700466:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835070720 00010000:00010000:2.0:1787032263.700694:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 12 pid: 6895 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.700743:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 83 00000100:00100000:2.0:1787032263.700755:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+12:2355:x1873838835070720:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032263.700773:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032263.700802:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 12 pid: 6895 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.700816:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 12 pid: 6895 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.700861:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81b3f1b/0xcd047797ef1ea788 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b18 expref: 12 pid: 6895 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.700876:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032263.700881:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032263.700889:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.700902:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.700943:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.700958:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfaf89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1873838857074432:192.168.201.48@tcp:105: 00000100:00100000:2.0:1787032263.701346:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787032263.703994:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfaf89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5783:1873838857074432:192.168.201.48@tcp:105: 00010000:00010000:2.0:1787032263.704301:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032263.704402:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d144536-0f5d-43dc-8f25-f68546215872+11:2355:x1873838835070720:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 3648us (5804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.704415:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 83 00000100:00100000:1.0:1787032263.710735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.710817:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835070848 00000100:00100000:2.0:1787032263.710827:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835070848 00002000:00100000:2.0:1787032263.710880:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff99cdff65c000 x1873838835070848/t0(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:124/0 lens 504/0 e 0 to 0 dl 1787032274 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787032263.710906:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdff65c000 with x1873838835070848 ext(0->12) 00002000:00010000:2.0:1787032263.710911:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdff65c000 00000100:00100000:2.0:1787032263.710948:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:2.0:1787032263.710957:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5d144536-0f5d-43dc-8f25-f68546215872+11:2354:x1873838835070848:12345-192.168.201.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787032263.711499:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5d144536-0f5d-43dc-8f25-f68546215872+13:2354:x1873838835070848:12345-192.168.201.48@tcp:4:lhsmtool_posix.0 Request processed in 541us (772us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787032263.711506:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00002000:00100000:2.0:1787032263.711513:0:6592:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff99cdff65c000 x1873838835070848/t4294967320(0) o4->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:124/0 lens 504/448 e 0 to 0 dl 1787032274 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787032263.711521:0:6592:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cdff65c000 with x1873838835070848 ext(0->12) 00002000:00010000:2.0:1787032263.711524:0:6592:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cdff65c000 00000100:00100000:2.0:1787032263.714979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.715114:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835070976 00000100:00100000:1.0:1787032263.715124:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835070976 00000100:00100000:1.0:1787032263.715186:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 227 00000100:00100000:1.0:1787032263.715197:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+66:11583:x1873838835070976:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787032263.750997:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967485 is committed 00000020:00080000:2.0:1787032263.751034:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cdc892f6c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787032263.751041:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdd891bd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cdc892f600 00000020:00080000:2.0:1787032263.751045:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdd891b500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdc61e7800 00000020:00080000:2.0:1787032263.751085:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1787032263.751096:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:2.0:1787032263.751116:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787032263.751391:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:0.0:1787032263.751621:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:2.0:1787032263.751734:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000001:00080000:2.0:1787032263.751759:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787032263.751770:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787032263.751791:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cded1496c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787032263.751795:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdd891b100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cdc33c3d80 00000020:00080000:2.0:1787032263.751804:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdd891b700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdcbb53000 00000100:00100000:2.0:1787032263.751945:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfaf88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857074560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787032263.752026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032263.752109:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857074560 00000100:00100000:2.0:1787032263.752117:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857074560 00000100:00100000:2.0:1787032263.752278:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787032263.752288:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857074560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787032263.752313:0:6895:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787032263.752339:0:6895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.752364:0:6895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 12 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.752373:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787032263.752378:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787032263.752383:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.752413:0:6895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 12 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.752499:0:6895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 12 pid: 6586 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.752513:0:6895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb35bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857074688:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032263.752597:0:6895:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032263.754298:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787032263.754315:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857074816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787032263.754362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032263.754400:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857074816 00000100:00100000:0.0:1787032263.754405:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857074816 00000100:00100000:0.0:1787032263.754611:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787032263.754621:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857074816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787032263.754645:0:6587:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1787032263.754676:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a83f2c6, atime: 0x6a83f2c6, ctime: 0x6a83f2c6, blocks: 0x1 00010000:00010000:0.0:1787032263.754684:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.754700:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:0.0:1787032263.754704:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032263.754711:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.754727:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.754737:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.754744:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.754765:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787032263.756661:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1873838857074816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2031us (2287us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787032263.756676:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1787032263.756716:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032263.756725:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.756737:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032263.756741:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.756752:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.756772:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.756780:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030016dfe/0xcd047797ef1ea79d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.756801:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032263.756803:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032263.756805:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787032263.756817:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787032263.756865:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:1.0:1787032263.758351:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cde4873b80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787032263.758365:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857074816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787032263.758644:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:11583:x1873838835070976:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 Request processed in 43445us (43672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.758655:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 227 00000100:00100000:2.0:1787032263.762459:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.762527:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.762909:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835071232 00000100:00100000:0.0:1787032263.762920:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835071232 00000100:00100000:0.0:1787032263.762984:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 68 00000100:00100000:0.0:1787032263.763014:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+13:2357:x1873838835071232:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787032263.764994:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835071104 00000100:00100000:1.0:1787032263.765007:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835071104 00010000:00010000:1.0:1787032263.765048:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 14 pid: 6586 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.765124:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 84 00000100:00100000:1.0:1787032263.765135:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+14:2355:x1873838835071104:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.765160:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.765166:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 14 pid: 6586 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.765195:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 14 pid: 6586 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.765219:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787032263.765224:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787032263.765230:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.765240:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.765260:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032263.765313:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+14:2355:x1873838835071104:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 180us (2865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.765321:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 84 00010000:00010000:3.0:1787032263.768834:0:6895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a7e expref: 13 pid: 6586 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.768863:0:6895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb35bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857074688:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032263.768889:0:6895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.769111:0:6895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.769121:0:6895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.769135:0:6895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.769144:0:6895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.769198:0:6895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787032263.769806:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1873838857074560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17516us (17777us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787032263.769816:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1787032263.770040:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032263.770048:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.770058:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032263.770062:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.770093:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.770114:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.770123:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1ea796 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.770140:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032263.770142:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032263.770154:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787032263.770813:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cdfaf88380/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787032263.770838:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfaf88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857074560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787032263.799986:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+12:2357:x1873838835071232:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 Request processed in 36971us (37446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.800060:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 68 00000001:00080000:2.0:1787032263.800511:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1787032263.800527:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1787032263.800534:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1787032263.803865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.803964:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835071488 00000100:00100000:0.0:1787032263.803976:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835071488 00000100:00100000:0.0:1787032263.804232:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 228 00000100:00100000:0.0:1787032263.804258:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+20:11583:x1873838835071488:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787032263.804328:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032263.804364:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030000/0xcd047797ef1ea781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b11 expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.804384:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:0.0:1787032263.804390:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032263.804552:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.804577:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.804588:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787032263.804889:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0b300f1 reply state 000000001201823d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.804900:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787032263.805325:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+21:11583:x1873838835071488:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 1067us (1472us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787032263.805334:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 228 00010000:00010000:2.0:1787032263.808769:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.808788:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.808797:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.808804:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.808809:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.808816:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.808833:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:2.0:1787032263.808850:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032263.808855:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.808862:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.808982:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.809179:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835071616 00000100:00100000:2.0:1787032263.809189:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835071616 00000100:00100000:2.0:1787032263.809246:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 69 00000100:00100000:2.0:1787032263.809255:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835071616:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787032263.809632:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787032263.809636:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787032262 00002000:00010000:2.0:1787032263.809638:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787032262 00002000:00010000:2.0:1787032263.809641:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787032263 -> 1787032262 00002000:00010000:2.0:1787032263.809643:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787032263.809707:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2354:x1873838835071616:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 452us (731us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787032263.809714:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 69 00000100:00100000:2.0:1787032263.812673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.812749:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835071872 00000100:00100000:3.0:1787032263.812759:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835071872 00000100:00100000:3.0:1787032263.812820:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 229 00000100:00100000:3.0:1787032263.812831:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+20:11583:x1873838835071872:12345-192.168.201.48@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787032263.812919:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.812942:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.812952:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.812990:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.813014:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 20 pid: 5797 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.813030:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff657100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857074944:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032263.813165:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb46d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787032263.816370:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff657100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5799:1873838857074944:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032263.816503:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.818026:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.818824:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835072000 00000100:00100000:1.0:1787032263.818835:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835072000 00010000:00010000:1.0:1787032263.818881:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 21 pid: 5797 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.818922:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 85 00000100:00100000:1.0:1787032263.818933:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+21:2354:x1873838835072000:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.818948:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.818956:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 21 pid: 5797 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.818982:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 21 pid: 5797 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.819021:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ea765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b03 expref: 21 pid: 5797 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.819039:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:1.0:1787032263.819044:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.819054:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.819062:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.819131:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032263.819192:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:2354:x1873838835072000:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 262us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.819200:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 85 00010000:00010000:0.0:1787032263.819659:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.819669:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.819709:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.819716:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.819722:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.819728:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032263.819733:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.819740:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.819750:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:0.0:1787032263.819752:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787032263.819756:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.819762:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ea7ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.819820:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+19:11583:x1873838835071872:12345-192.168.201.48@tcp:55:lhsmtool_posix.0 Request processed in 6991us (7158us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787032263.819830:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 229 00000100:00100000:0.0:1787032263.822987:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.823200:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835072128 00000100:00100000:3.0:1787032263.823210:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835072128 00000100:00100000:3.0:1787032263.823261:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 70 00000100:00100000:3.0:1787032263.823269:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+8:2356:x1873838835072128:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787032263.823315:0:6895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.823336:0:6895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.823344:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032263.823349:0:6895:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787032263.823353:0:6895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.823388:0:6895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032263.823402:0:6895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 8 pid: 6584 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032263.823544:0:6895:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff657100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857075072:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032263.823632:0:6895:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb46d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787032263.825665:0:6895:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff657100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6895:1873838857075072:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032263.825697:0:6895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.827336:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.827597:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835072256 00000100:00100000:1.0:1787032263.827606:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835072256 00010000:00010000:1.0:1787032263.827649:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 9 pid: 6584 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.827691:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00100000:1.0:1787032263.827701:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+9:2355:x1873838835072256:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.827731:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.827759:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 9 pid: 6584 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.827774:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 9 pid: 6584 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.827801:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070ba1b10/0xcd047797ef1ea78f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b1f expref: 9 pid: 6584 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.827819:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787032263.827824:0:5784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787032263.827830:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.827841:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.827935:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032263.828009:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+8:2355:x1873838835072256:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 298us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.828018:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 86 00010000:00010000:2.0:1787032263.829793:0:6895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.829811:0:6895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.829845:0:6895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.829874:0:6895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.829883:0:6895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.829891:0:6895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418a00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032263.829896:0:6895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.829905:0:6895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.829922:0:6895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.829930:0:6895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dc9a86a/0xcd047797ef1ea7b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.830324:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d144536-0f5d-43dc-8f25-f68546215872+7:2356:x1873838835072128:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 Request processed in 7050us (7341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.830336:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 70 00000100:00100000:0.0:1787032263.833555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.833688:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835072512 00000100:00100000:2.0:1787032263.833698:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835072512 00000100:00100000:2.0:1787032263.833798:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 230 00000100:00100000:2.0:1787032263.833820:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+19:11583:x1873838835072512:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787032263.833911:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.833930:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.833944:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.834365:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.834377:0:7755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.834386:0:7755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.834493:0:7755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.834507:0:7755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 20 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.834521:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857075200:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032263.834617:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787032263.836830:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857075200:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032263.836860:0:7755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.838996:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.839217:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835072640 00000100:00100000:1.0:1787032263.839228:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835072640 00010000:00010000:1.0:1787032263.839273:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 21 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.839340:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 87 00000100:00100000:1.0:1787032263.839351:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+21:2355:x1873838835072640:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.839368:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.839375:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 21 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.839389:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 21 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.839414:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031600/0xcd047797ef1ea773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b0a expref: 21 pid: 5798 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.839441:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:1.0:1787032263.839447:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.839456:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.839464:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.839490:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032263.839544:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:2355:x1873838835072640:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 195us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.839552:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 87 00010000:00010000:0.0:1787032263.839728:0:7755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.839737:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787032263.839932:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787032263.840141:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787032263.840186:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787032263.840281:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7755:1873838857075328:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787032263.840331:0:7755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032263.840363:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfba4dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032263.841278:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857075328 00000100:00100000:1.0:1787032263.841298:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857075328 00000100:00100000:1.0:1787032263.841345:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032263.841353:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7755:x1873838857075328:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787032263.841459:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7755:x1873838857075328:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.841467:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787032263.841639:0:7755:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1787032263.841647:0:7755:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1787032263.841674:0:7755:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff99cdfaf88380 x1873838857074560/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787032279 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032263.841686:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ce011a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7755:1873838857075328:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787032263.842233:0:7755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787032263.842314:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7755:1873838857075456:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787032263.842363:0:7755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032263.842389:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787032263.843035:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857075456 00000100:00100000:1.0:1787032263.843042:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857075456 00000100:00100000:1.0:1787032263.843115:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787032263.843125:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7755:x1873838857075456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787032263.843335:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7755:x1873838857075456:12345-0@lo:1000:mdt00_003.0 Request processed in 212us (972us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787032263.843343:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787032263.843796:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4981c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7755:1873838857075456:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787032263.843849:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843860:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843868:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843875:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.843880:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843887:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843902:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdcba3af00) 00010000:00010000:2.0:1787032263.843916:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787032263.843922:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843928:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7600/0xcd047797ef1ea7c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843960:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843967:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843973:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843978:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.843981:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843987:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.843995:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032263.844140:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787032263.844209:0:7755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aee expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.844222:0:7755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aee expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.844231:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aee expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.844273:0:7755:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aee expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.844288:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4982300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857075584:192.168.201.48@tcp:105: 00000100:00100000:2.0:1787032263.844370:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787032263.849886:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.849961:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835072768 00000100:00100000:1.0:1787032263.849972:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835072768 00000100:00100000:1.0:1787032263.850051:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00100000:1.0:1787032263.850063:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:11582:x1873838835072768:12345-192.168.201.48@tcp:49:lfs.0 00000100:00100000:1.0:1787032263.850245:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:11582:x1873838835072768:12345-192.168.201.48@tcp:49:lfs.0 Request processed in 184us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.850253:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 61 00000100:00100000:1.0:1787032263.853848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032263.853955:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835073024 00000100:00100000:3.0:1787032263.853967:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835073024 00000100:00100000:3.0:1787032263.854050:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 231 00000100:00100000:3.0:1787032263.854061:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+24:11582:x1873838835073024:12345-192.168.201.48@tcp:58:lfs.0 00000100:00100000:2.0:1787032263.855031:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4982300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7755:1873838857075584:192.168.201.48@tcp:105: 00010000:00010000:2.0:1787032263.855086:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855098:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031c00/0xcd047797ef1ea703 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855129:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855142:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855163:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855172:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855178:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855184:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855202:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.855206:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855213:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855224:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032263.855227:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032263.855231:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855237:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7e00/0xcd047797ef1ea7c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855248:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855254:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855259:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855264:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.855266:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855272:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855288:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032263.855290:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787032263.855293:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.855298:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea7b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.855519:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+24:11583:x1873838835072512:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 21700us (21976us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787032263.855529:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 230 00000020:00080000:2.0:1787032263.855534:0:7755:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787032263.855768:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787032263.855772:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787032263.856279:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787032263.856288:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787032263.857869:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787032263.857980:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+23:11582:x1873838835073024:12345-192.168.201.48@tcp:58:lfs.0 Request processed in 3915us (4143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032263.857991:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 231 00000100:00100000:1.0:1787032263.862933:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.863049:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835073280 00000100:00100000:2.0:1787032263.863062:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835073280 00000100:00100000:3.0:1787032263.863286:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 62 00000100:00100000:3.0:1787032263.863299:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+23:11583:x1873838835073280:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787032263.863966:0:5801:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787032263.876202:0:5801:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787032263.876295:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.876314:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.876338:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.876348:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.876354:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.876361:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.876376:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787032263.876498:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+25:11583:x1873838835073280:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 13198us (13571us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787032263.876510:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 62 00000020:00080000:1.0:1787032263.876516:0:5801:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787032263.877161:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032263.877170:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.877179:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032263.877183:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.877192:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.877207:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032263.877211:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787032263.877229:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.877235:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1ea7ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.877257:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032263.877259:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032263.877261:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032263.886885:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032263.887019:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835073408 00000100:00100000:0.0:1787032263.887032:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835073408 00000100:00100000:0.0:1787032263.887131:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 232 00000100:00100000:0.0:1787032263.887141:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+25:11585:x1873838835073408:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032263.887173:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032263.887198:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea7d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b26 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887269:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887284:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887295:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887309:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887316:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887342:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887691:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887702:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887711:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887746:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 26 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032263.887761:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 26 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032263.887775:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857075712:192.168.201.48@tcp:104: 00000100:00100000:0.0:1787032263.887867:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfba4d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032263.891536:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032263.891650:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835073664 00000100:00100000:2.0:1787032263.891660:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835073664 00000100:00100000:2.0:1787032263.891736:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:2.0:1787032263.891748:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+27:5569:x1873838835073664:12345-192.168.201.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787032263.891757:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5798:1873838857075712:192.168.201.48@tcp:104: 00010000:00010000:0.0:1787032263.891802:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032263.892026:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+28:5569:x1873838835073664:12345-192.168.201.48@tcp:35:ldlm_bl.0 Request processed in 279us (499us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787032263.892035:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 63 00000100:00100000:2.0:1787032263.894854:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032263.895110:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835073792 00000100:00100000:1.0:1787032263.895123:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835073792 00010000:00010000:1.0:1787032263.895178:0:5784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 28 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.895229:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 88 00000100:00100000:1.0:1787032263.895241:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+28:2355:x1873838835073792:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032263.895257:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032263.895264:0:5784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 28 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.895300:0:5784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 28 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.895324:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ea6f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ae7 expref: 28 pid: 5799 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.895342:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032263.895348:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.895356:0:5784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.895362:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032263.895394:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787032263.895427:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.895435:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032263.895455:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d144536-0f5d-43dc-8f25-f68546215872+27:2355:x1873838835073792:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 217us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.895462:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 88 00000004:00200000:2.0:1787032263.895487:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787032263.895492:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032263.896641:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896660:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896671:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896677:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896683:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896690:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.896695:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896704:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896718:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:2.0:1787032263.896721:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032263.896726:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896733:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536400/0xcd047797ef1ea7dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896768:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896773:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896778:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896783:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032263.896786:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896791:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896799:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99cdc4f0a100) 00010000:00010000:2.0:1787032263.896802:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032263.896804:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896810:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536000/0xcd047797ef1ea7e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896853:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536600/0xcd047797ef1ea7d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b26 expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896868:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b26 expref: 26 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032263.896886:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032263.896889:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032263.896891:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537c00, rc 0) 00000100:00100000:2.0:1787032263.897018:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+26:11585:x1873838835073408:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 9862us (10130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032263.897026:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 232 00000004:00080000:2.0:1787032263.937402:0:7950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418783331985ns, next at 419783330079ns, rc = 0 00000100:00100000:3.0:1787032263.937457:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787032263.937478:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857075840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032263.937556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032263.937746:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857075968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032263.937771:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032263.937841:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857075840 00000100:00100000:0.0:1787032263.937850:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857075840 00000100:00100000:0.0:1787032263.937899:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857075968 00000100:00100000:0.0:1787032263.937902:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857075968 00000100:00100000:0.0:1787032263.937930:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787032263.937938:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857075840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032263.937964:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787032263.938030:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857075840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.938032:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787032263.938037:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787032263.938043:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857075968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032263.938055:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032263.938108:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857075968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032263.938114:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787032263.938150:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857075968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032263.938630:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857075840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787032264.408364:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787032264.648414:0:12426:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032264.648423:0:12426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032264.648465:0:12426:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787032264.648470:0:12426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787032264.901360:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032264.901435:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032264.901481:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787032264.901486:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787032264.901620:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857076096:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787032264.901734:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdfba4dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032264.912330:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032264.912496:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835073920 00000100:00100000:2.0:1787032264.912506:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835073920 00000100:00100000:2.0:1787032264.912592:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 233 00000100:00100000:2.0:1787032264.912603:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+27:11597:x1873838835073920:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787032264.912645:0:7755:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787032264.912757:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+27:11597:x1873838835073920:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 155us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032264.912765:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 233 00000100:00080000:1.0:1787032264.913350:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032264.913898:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1873838857076096:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787032264.924563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032264.924653:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835074176 00000100:00100000:3.0:1787032264.924678:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835074176 00000100:00100000:3.0:1787032264.924738:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 234 00000100:00100000:3.0:1787032264.924748:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+26:11597:x1873838835074176:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032264.924769:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032264.924792:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea7f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b2d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032264.924898:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea7f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032264.924913:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032264.924925:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032264.924938:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787032264.925103:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea7f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b2d expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032264.925124:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b2d expref: 28 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032264.925134:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032264.925137:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032264.925140:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419e00, rc 0) 00000100:00100000:3.0:1787032264.925201:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+28:11597:x1873838835074176:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 456us (659us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787032264.925207:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 234 00000100:00100000:2.0:1787032264.941648:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032264.942025:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835074432 00000100:00100000:0.0:1787032264.942035:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835074432 00000100:00100000:0.0:1787032264.942134:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 235 00000100:00100000:0.0:1787032264.942144:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+28:11597:x1873838835074432:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787032264.942304:0:7755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942322:0:7755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942333:0:7755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942528:0:7755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942535:0:7755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942552:0:7755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942558:0:7755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032264.942562:0:7755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942569:0:7755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942581:0:7755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:1.0:1787032264.942584:0:7755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787032264.942589:0:7755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032264.942594:0:7755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775200/0xcd047797ef1ea806 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032264.942763:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+29:11597:x1873838835074432:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 620us (1124us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787032264.942772:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 235 00000100:00100000:1.0:1787032264.944565:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032264.944677:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835074560 00000100:00100000:2.0:1787032264.944685:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835074560 00000100:00100000:2.0:1787032264.944742:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:2.0:1787032264.944751:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+29:2355:x1873838835074560:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032264.944766:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032264.944788:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ea7f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b2d expref: 29 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032264.944824:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:2.0:1787032264.944829:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032264.944881:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d144536-0f5d-43dc-8f25-f68546215872+28:2355:x1873838835074560:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032264.944889:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000040:00080000:0.0:1787032264.946230:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032264.946239:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032264.946723:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787032264.946731:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787032264.947663:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032264.947735:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835074816 00000100:00100000:2.0:1787032264.947744:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835074816 00000100:00100000:2.0:1787032264.947795:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 64 00000100:00100000:2.0:1787032264.947804:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+28:11597:x1873838835074816:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787032264.948047:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+29:11597:x1873838835074816:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 243us (390us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787032264.948055:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 64 00010000:00010000:0.0:1787032265.416787:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032266.382487:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032266.382540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032266.382573:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032266.382603:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032266.382631:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032266.382661:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835075328 00000100:00100000:3.0:1787032266.382671:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835075328 00000100:00100000:3.0:1787032266.382729:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835075200 00000100:00100000:3.0:1787032266.382732:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835075200 00000100:00100000:3.0:1787032266.382756:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 94 00000100:00100000:3.0:1787032266.382766:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2356:x1873838835075328:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032266.382839:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2356:x1873838835075328:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032266.382846:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 94 00000100:00100000:3.0:1787032266.382863:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 95 00000100:00100000:3.0:1787032266.382870:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2356:x1873838835075200:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032266.382895:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2356:x1873838835075200:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032266.382901:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 95 00000100:00100000:3.0:1787032266.382919:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835075072 00000100:00100000:3.0:1787032266.382922:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835075072 00000100:00100000:3.0:1787032266.382949:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 159 00000100:00100000:3.0:1787032266.382955:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:2357:x1873838835075072:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032266.383002:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:2357:x1873838835075072:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 46us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032266.383027:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 159 00000100:00100000:3.0:1787032266.383038:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835075456 00000100:00100000:3.0:1787032266.383041:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835075456 00000100:00100000:3.0:1787032266.383098:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 160 00000100:00100000:3.0:1787032266.383105:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2356:x1873838835075456:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032266.383137:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2356:x1873838835075456:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 32us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032266.383143:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 160 00000100:00080000:3.0:1787032266.383160:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787032266.383164:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787032266.383166:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032266.383348:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835074944 00000100:00100000:0.0:1787032266.383353:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835074944 00000100:00100000:0.0:1787032266.383389:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 295 00000100:00100000:0.0:1787032266.383396:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835074944:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032266.383429:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835074944:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 33us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032266.383435:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 295 00010000:00010000:2.0:1787032266.436012:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787032266.713156:0:12477:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787032266.713167:0:12477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032266.713213:0:12477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787032266.713219:0:12477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787032266.896581:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032266.896659:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835075712 00000100:00100000:3.0:1787032266.896670:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835075712 00000100:00100000:3.0:1787032266.896807:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 236 00000100:00100000:3.0:1787032266.896818:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+29:11617:x1873838835075712:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032266.896842:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032266.896864:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea80d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b34 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.896982:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea814 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.896997:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.897590:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032266.897627:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787032266.897874:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea80d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b34 expref: 32 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.897893:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b34 expref: 31 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.897903:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032266.897906:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787032266.897910:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418c00, rc 0) 00000100:00100000:3.0:1787032266.898216:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d144536-0f5d-43dc-8f25-f68546215872+31:11617:x1873838835075712:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1399us (1645us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787032266.898225:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 236 00000100:00100000:1.0:1787032266.907749:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032266.907891:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835075840 00000100:00100000:3.0:1787032266.907901:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835075840 00000100:00100000:3.0:1787032266.907970:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 237 00000100:00100000:3.0:1787032266.907981:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+31:11617:x1873838835075840:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:3.0:1787032266.908056:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908102:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908117:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908148:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908165:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908173:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908178:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419000 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032266.908183:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908190:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908202:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032266.908205:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787032266.908210:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032266.908217:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419000/0xcd047797ef1ea822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032266.908293:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d144536-0f5d-43dc-8f25-f68546215872+31:11617:x1873838835075840:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 313us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032266.908302:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 237 00000100:00100000:2.0:1787032267.038942:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032267.040700:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835075968 00000100:00100000:3.0:1787032267.040725:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835075968 00000100:00100000:0.0:1787032267.040867:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 71 00000100:00100000:0.0:1787032267.040880:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2356:x1873838835075968:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:0.0:1787032267.040898:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032267.040920:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea829 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b3b expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787032267.040948:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a83f2c6, atime: 0x6a83f2c6, ctime: 0x6a83f2c6, blocks: 0xb 00010000:00010000:0.0:1787032267.040968:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1787032267.040972:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032267.040982:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b3b expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032267.040999:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b3b expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032267.041033:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1537800, rc 0) 00000100:00100000:0.0:1787032267.041485:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2356:x1873838835075968:12345-192.168.201.48@tcp:101:cat.0 Request processed in 604us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032267.041495:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 71 00000100:00100000:2.0:1787032267.046309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032267.046430:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835076096 00000100:00100000:1.0:1787032267.046441:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835076096 00002000:00100000:1.0:1787032267.046498:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff99cde4983480 x1873838835076096/t0(0) o3->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:128/0 lens 488/0 e 0 to 0 dl 1787032278 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032267.046520:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cde4983480 with x1873838835076096 ext(0->4095) 00002000:00010000:1.0:1787032267.046525:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cde4983480 00000100:00100000:1.0:1787032267.046608:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:1.0:1787032267.046619:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2357:x1873838835076096:12345-192.168.201.48@tcp:3:cat.0 00000100:00100000:1.0:1787032267.046862:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5d144536-0f5d-43dc-8f25-f68546215872+8:2357:x1873838835076096:12345-192.168.201.48@tcp:3:cat.0 Request processed in 245us (564us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787032267.046871:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00002000:00100000:1.0:1787032267.046878:0:6590:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff99cde4983480 x1873838835076096/t0(0) o3->5d144536-0f5d-43dc-8f25-f68546215872@192.168.201.48@tcp:128/0 lens 488/4536 e 0 to 0 dl 1787032278 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787032267.046887:0:6590:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99cde4983480 with x1873838835076096 ext(0->4095) 00002000:00010000:1.0:1787032267.046890:0:6590:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99cde4983480 00010000:00010000:0.0:1787032267.458562:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787032267.585684:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787032267.585878:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1787032268.481364:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032268.547171:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857076608:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.547236:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857076352:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.547282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032268.547321:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032268.547349:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857076864:0@lo:400:kworker.0 00000100:00100000:1.0:1787032268.547359:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787032268.547369:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857076224:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.547379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032268.547406:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032268.547412:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857076480:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.547446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032268.547486:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857076352 00000100:00100000:2.0:1787032268.547494:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857076352 00000100:00100000:1.0:1787032268.547507:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032268.547540:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857076736:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.547548:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857076480 00000100:00100000:2.0:1787032268.547552:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857076480 00000100:00100000:1.0:1787032268.547569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032268.547696:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857076608 00000100:00100000:0.0:1787032268.547701:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857076608 00000100:00100000:0.0:1787032268.547733:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857076864 00000100:00100000:0.0:1787032268.547736:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857076864 00000100:00100000:0.0:1787032268.547759:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787032268.547767:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857076608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032268.548365:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857076224 00000100:00100000:1.0:1787032268.548372:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857076224 00000100:00100000:1.0:1787032268.548493:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787032268.548502:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857076224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032268.549093:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857076608:12345-0@lo:400:kworker.0 Request processed in 1323us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032268.549102:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787032268.549128:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787032268.549135:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857076864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032268.549175:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857076864:12345-0@lo:400:kworker.0 Request processed in 41us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032268.549182:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787032268.549246:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857076864:0@lo:400:kworker.0 00000100:00100000:0.0:1787032268.549280:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787032268.549288:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787032268.549317:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cde4873b80, transno 4294967310 00000100:00100000:0.0:1787032268.549329:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857076608:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.550886:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857076736 00000100:00100000:2.0:1787032268.550898:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857076736 00000100:00100000:0.0:1787032268.550928:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787032268.550941:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857076352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032268.551373:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857076352:12345-0@lo:400:kworker.0 Request processed in 434us (4089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032268.556196:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3302:x1873838857076224:12345-0@lo:400:kworker.0 Request processed in 7684us (8678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032268.556210:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787032268.556313:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:3302:1873838857076224:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.557130:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787032268.557148:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857076480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032268.557181:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857076352:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.557239:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857076480:12345-0@lo:400:kworker.0 Request processed in 99us (9791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032268.557247:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787032268.557269:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857076480:0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.557270:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787032268.557281:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857076736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032268.557326:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857076736:12345-0@lo:400:kworker.0 Request processed in 47us (9757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032268.557332:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1787032268.557351:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032268.557356:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032268.557359:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032268.557404:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857076736:0@lo:400:kworker.0 00000100:00100000:0.0:1787032268.560192:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787032269.057543:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787032269.057568:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857076992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032269.057642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787032269.058638:0:7950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 423904568327ns, next at 424904565969ns, rc = 0 00000100:00100000:2.0:1787032269.058660:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857077120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032269.058700:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032269.058753:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857076992 00000100:00100000:2.0:1787032269.058761:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857076992 00000100:00100000:2.0:1787032269.058808:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857077120 00000100:00100000:2.0:1787032269.058812:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857077120 00000100:00100000:2.0:1787032269.058831:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787032269.058848:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857076992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032269.058883:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032269.058929:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857076992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032269.058936:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787032269.058952:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787032269.058957:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857077120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032269.058974:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032269.059006:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857077120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032269.059013:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787032269.059056:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857077120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032269.059112:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857076992:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787032269.121104:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000020:00080000:2.0:1787032269.121136:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787032269.121140:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000001:00080000:2.0:1787032269.121150:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:2.0:1787032269.121155:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000004:00080000:2.0:1787032269.121161:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787032269.121178:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99cde4b2ec00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787032269.121183:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdef0f7b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99cde4b2e180 00000020:00080000:2.0:1787032269.121186:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99cdef0f7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99cdffec8c00 00000001:00080000:2.0:1787032269.121202:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787032269.121496:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787032269.121691:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1787032269.121766:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032269.121787:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857077248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787032269.121856:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032269.121935:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857077248 00000100:00100000:0.0:1787032269.121943:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857077248 00000100:00100000:0.0:1787032269.121988:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787032269.121996:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857077248:12345-0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1787032269.122404:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1787032269.122413:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00002000:00010000:0.0:1787032269.122730:0:6586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787032269.122734:0:6586:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787032262 -> 1787032262 00002000:00010000:0.0:1787032269.122736:0:6586:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1787032262 -> 1787032262 00002000:00010000:0.0:1787032269.122738:0:6586:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787032262 -> 1787032262 00002000:00010000:0.0:1787032269.122741:0:6586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787032269.122786:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857077248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 790us (929us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787032269.122794:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787032269.123191:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1787032269.123198:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cdfaf88380, transno 4294967321 00000004:00080000:2.0:1787032269.123212:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1787032269.123234:0:3302:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff99cdff536680 x1873838857077248/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787032285 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787032269.123245:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cdff536680/2, rc 0, transno 4294967324 00000100:00100000:2.0:1787032269.123251:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857077248:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1787032269.506363:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787032270.102844:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787032270.102854:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787032270.102911:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787032270.102918:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787032270.532519:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032271.499902:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032271.499967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032271.500005:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032271.500032:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032271.500057:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032271.500118:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835076480 00000100:00100000:1.0:1787032271.500131:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835076480 00000100:00100000:1.0:1787032271.500207:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835076608 00000100:00100000:1.0:1787032271.500211:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835076608 00000100:00100000:1.0:1787032271.500239:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 98 00000100:00100000:1.0:1787032271.500252:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2354:x1873838835076480:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032271.500372:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2354:x1873838835076480:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 122us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032271.500380:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 98 00000100:00100000:1.0:1787032271.500401:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 99 00000100:00100000:1.0:1787032271.500408:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835076608:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032271.500451:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835076608:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 43us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032271.500458:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 99 00000100:00100000:0.0:1787032271.500888:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835076224 00000100:00100000:0.0:1787032271.500904:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835076224 00000100:00100000:0.0:1787032271.500945:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 297 00000100:00100000:0.0:1787032271.500952:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838835076224:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032271.501000:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838835076224:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 48us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032271.501007:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 297 00000100:00100000:2.0:1787032271.502050:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835076352 00000100:00100000:2.0:1787032271.502061:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835076352 00000100:00100000:2.0:1787032271.502148:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835076736 00000100:00100000:2.0:1787032271.502152:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835076736 00000100:00100000:2.0:1787032271.502186:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 164 00000100:00100000:2.0:1787032271.502194:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaf88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+18:2354:x1873838835076352:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032271.502262:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaf88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+18:2354:x1873838835076352:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 69us (2295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032271.502269:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 164 00000100:00100000:2.0:1787032271.502284:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 165 00000100:00100000:2.0:1787032271.502289:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff65ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838835076736:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032271.502311:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff65ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:2354:x1873838835076736:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 22us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032271.502316:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 165 00000100:00080000:2.0:1787032271.502344:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787032271.502350:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032271.502353:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787032271.554260:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032272.411924:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032272.412190:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835076864 00000100:00100000:2.0:1787032272.412213:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835076864 00000100:00100000:2.0:1787032272.412277:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 238 00000100:00100000:2.0:1787032272.412287:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+18:11262:x1873838835076864:12345-192.168.201.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787032272.412392:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+18:11262:x1873838835076864:12345-192.168.201.48@tcp:60:lhsmtool_posix.0 Request processed in 107us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032272.412400:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 238 00000100:00100000:0.0:1787032272.438324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032272.438625:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835077120 00000100:00100000:3.0:1787032272.438636:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835077120 00000100:00100000:3.0:1787032272.438696:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 65 00000100:00100000:3.0:1787032272.438706:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+18:11262:x1873838835077120:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787032272.439772:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+19:11262:x1873838835077120:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 1060us (1451us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787032272.439782:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 65 00010000:00010000:2.0:1787032272.577351:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032272.656666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032272.659045:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835077248 00000100:00100000:2.0:1787032272.659093:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835077248 00000100:00100000:2.0:1787032272.659277:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 239 00000100:00100000:2.0:1787032272.659293:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+5:12068:x1873838835077248:12345-192.168.201.48@tcp:101:lsof.0 00010000:00010000:2.0:1787032272.659324:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032272.659353:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b42 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032272.659460:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea837 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032272.659477:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032272.659493:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032272.659815:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787032272.659828:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032272.659946:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032272.659979:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1ea830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b42 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032272.660001:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea837 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b42 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032272.660012:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:2.0:1787032272.660016:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032272.660020:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6200, rc 0) 00000100:00100000:2.0:1787032272.660181:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:12068:x1873838835077248:12345-192.168.201.48@tcp:101:lsof.0 Request processed in 890us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032272.660190:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 239 00010000:00010000:2.0:1787032273.601429:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032273.665947:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857077632:0@lo:400:kworker.0 00000100:00100000:0.0:1787032273.665954:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857077760:0@lo:400:kworker.0 00000100:00100000:3.0:1787032273.666108:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857077504:0@lo:400:kworker.0 00000100:00100000:2.0:1787032273.666236:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857077376:0@lo:400:kworker.0 00000100:00100000:1.0:1787032273.666751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032273.666856:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857077632 00000100:00100000:1.0:1787032273.666866:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857077632 00000100:00100000:1.0:1787032273.666932:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787032273.666944:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857077632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032273.667001:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857077632:12345-0@lo:400:kworker.0 Request processed in 61us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032273.667009:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787032273.667036:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032273.667082:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857077632:0@lo:400:kworker.0 00000100:00100000:3.0:1787032273.668138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032273.668197:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdefbd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857078016:0@lo:400:kworker.0 00000100:00100000:3.0:1787032273.668241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032273.668780:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857078016 00000100:00100000:1.0:1787032273.668794:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857078016 00000100:00100000:1.0:1787032273.668870:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787032273.668882:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857078016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032273.670836:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857078016:12345-0@lo:400:kworker.0 Request processed in 1948us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032273.670865:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1787032273.670915:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787032273.670931:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857077504 00000100:00100000:1.0:1787032273.670939:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857077504 00000100:00100000:1.0:1787032273.670990:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787032273.670997:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857077504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032273.671050:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857077504:12345-0@lo:400:kworker.0 Request processed in 53us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032273.671056:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787032273.671147:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857077504:0@lo:400:kworker.0 00000100:00100000:1.0:1787032273.671164:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdefbd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857078016:0@lo:400:kworker.0 00000100:00100000:0.0:1787032273.671841:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032273.672203:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032273.673135:0:6895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857077760 00000100:00100000:1.0:1787032273.673147:0:6895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857077760 00000100:00100000:1.0:1787032273.673239:0:6895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787032273.673252:0:6895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857077760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032273.673257:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857077888:0@lo:400:kworker.0 00000100:00080000:0.0:1787032273.673364:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032273.673421:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857077376 00000100:00100000:3.0:1787032273.673432:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857077376 00000100:00100000:3.0:1787032273.673501:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787032273.673510:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857077376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032273.673585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032273.673954:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857077888 00000100:00100000:0.0:1787032273.673962:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857077888 00000100:00100000:0.0:1787032273.674023:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1787032273.674039:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032273.674039:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857077888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032273.674160:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857077888:12345-0@lo:400:kworker.0 Request processed in 129us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032273.674168:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787032273.674508:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857077888:0@lo:400:kworker.0 00000100:00100000:1.0:1787032273.677032:0:6895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857077760:12345-0@lo:400:kworker.0 Request processed in 3771us (5186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032273.677047:0:6895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787032273.677170:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3304:x1873838857077376:12345-0@lo:400:kworker.0 Request processed in 3653us (4959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032273.677186:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787032273.677362:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857077760:0@lo:400:kworker.0 00000100:00100000:2.0:1787032273.677507:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857077376:0@lo:400:kworker.0 00000100:00100000:1.0:1787032274.178028:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857078144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032274.178115:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032274.178204:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857078144 00000100:00100000:1.0:1787032274.178211:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857078144 00000100:00100000:1.0:1787032274.178257:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787032274.178265:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857078144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032274.178300:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032274.178354:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857078144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032274.178362:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787032274.178424:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857078144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032274.183971:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032274.183993:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857078272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032274.184061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032274.184143:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857078272 00000100:00100000:3.0:1787032274.184150:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857078272 00000100:00100000:3.0:1787032274.184196:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787032274.184204:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857078272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787032274.184238:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032274.184279:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1873838857078272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032274.184302:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787032274.184347:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857078272:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787032274.248361:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000020:00080000:3.0:1787032274.267770:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1787032274.267793:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000004:00080000:3.0:1787032274.267802:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1787032274.267829:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787032274.267838:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787032274.627922:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032275.649391:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032276.625996:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032276.626049:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032276.626110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032276.626129:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032276.626151:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032276.626516:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835077760 00000100:00100000:2.0:1787032276.626546:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835077760 00000100:00100000:2.0:1787032276.626609:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835077632 00000100:00100000:2.0:1787032276.626613:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835077632 00000100:00100000:2.0:1787032276.626637:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 102 00000100:00100000:2.0:1787032276.626647:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2357:x1873838835077760:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032276.626726:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2357:x1873838835077760:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 81us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032276.626733:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 102 00000100:00100000:2.0:1787032276.626750:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 103 00000100:00100000:2.0:1787032276.626756:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838835077632:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032276.626778:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2357:x1873838835077632:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 23us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032276.626784:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 103 00000100:00080000:2.0:1787032276.626799:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032276.626803:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032276.626942:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835077376 00000100:00100000:2.0:1787032276.626947:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835077376 00000100:00100000:2.0:1787032276.626973:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 299 00000100:00100000:2.0:1787032276.626979:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835077376:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032276.627009:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2357:x1873838835077376:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 30us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032276.627015:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 299 00000100:00100000:0.0:1787032276.627043:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835077504 00000100:00100000:0.0:1787032276.627048:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835077504 00000100:00100000:0.0:1787032276.632340:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835077888 00000100:00100000:0.0:1787032276.632355:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835077888 00000100:00100000:0.0:1787032276.632418:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 169 00000100:00100000:0.0:1787032276.632432:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+18:2357:x1873838835077504:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032276.632511:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 170 00000100:00100000:0.0:1787032276.632545:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d144536-0f5d-43dc-8f25-f68546215872+18:2357:x1873838835077504:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 115us (6557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032276.632570:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 169 00000100:00080000:0.0:1787032276.632611:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032276.632624:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2357:x1873838835077888:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032276.633131:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2357:x1873838835077888:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 184us (6555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032276.633144:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 170 00010000:00010000:2.0:1787032276.680694:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787032277.500028:0:12681:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:51:15 (1787032275) 00010000:00010000:2.0:1787032277.697910:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032278.722228:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032278.794815:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787032278.797883:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857078528:0@lo:400:kworker.0 00000100:00100000:1.0:1787032278.797983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032278.798057:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857078400:0@lo:400:kworker.0 00000100:00100000:1.0:1787032278.798109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032278.798162:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857078400 00000100:00100000:3.0:1787032278.798173:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857078400 00000100:00100000:3.0:1787032278.798243:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787032278.798253:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857078400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032278.798333:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857078400:12345-0@lo:400:kworker.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032278.798343:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787032278.798405:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857078400:0@lo:400:kworker.0 00000100:00100000:0.0:1787032278.802517:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857078528 00000100:00100000:0.0:1787032278.802538:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857078528 00000100:00100000:0.0:1787032278.802619:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787032278.802629:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857078528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032278.802735:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857078528:12345-0@lo:400:kworker.0 Request processed in 107us (4752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032278.802743:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787032278.802804:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857078528:0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.803132:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857078656:0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.803190:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032278.803220:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032278.803226:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857078784:0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.803250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032278.803279:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857078656 00000100:00100000:2.0:1787032278.803283:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857078656 00000100:00100000:2.0:1787032278.803332:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787032278.803339:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857078656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.803377:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857078656:12345-0@lo:400:kworker.0 Request processed in 39us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032278.803384:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787032278.803401:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857078784 00000100:00100000:2.0:1787032278.803404:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857078784 00000100:00100000:2.0:1787032278.803433:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787032278.803439:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857078784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.803467:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857078784:12345-0@lo:400:kworker.0 Request processed in 29us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032278.803473:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787032278.803490:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032278.803495:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032278.803517:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857078784:0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.803525:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857078656:0@lo:400:kworker.0 00000100:00100000:1.0:1787032278.803593:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857078912:0@lo:400:kworker.0 00000100:00100000:1.0:1787032278.803625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032278.803653:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787032278.803657:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfadbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857079040:0@lo:400:kworker.0 00000100:00100000:1.0:1787032278.803681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032278.803825:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857079040 00000100:00100000:2.0:1787032278.803829:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857079040 00000100:00100000:2.0:1787032278.803880:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787032278.803887:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857079040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.803938:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857079040:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032278.803945:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787032278.803970:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787032278.803976:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cdff536680, transno 4294967324 00000100:00100000:2.0:1787032278.803988:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857079040:0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.804382:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857078912 00000100:00100000:2.0:1787032278.804386:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857078912 00000100:00100000:2.0:1787032278.804416:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787032278.804422:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857078912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032278.804458:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857078912:12345-0@lo:400:kworker.0 Request processed in 37us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032278.804465:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787032278.804495:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfadbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857078912:0@lo:400:kworker.0 00000100:00080000:0.0:1787032278.804766:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032278.804770:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032279.302713:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787032279.302745:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857079168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032279.302830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032279.302990:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857079168 00000100:00100000:1.0:1787032279.303001:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857079168 00000100:00100000:1.0:1787032279.303057:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787032279.303092:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857079168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787032279.303139:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032279.303192:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857079168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032279.303199:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787032279.303262:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857079168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032279.303563:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032279.303573:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdc61c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857079296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032279.303606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032279.303638:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857079296 00000100:00100000:3.0:1787032279.303642:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857079296 00000100:00100000:3.0:1787032279.303667:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787032279.303674:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857079296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787032279.303694:0:6588:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032279.303725:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857079296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032279.303732:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787032279.303760:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdc61c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857079296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787032279.745790:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787032280.321462:0:11549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787032280.321472:0:11549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787032280.322160:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787032280.322168:0:11549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787032280.769314:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032281.742454:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032281.742504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032281.742546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032281.742582:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032281.742620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032281.742662:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835078528 00000100:00100000:1.0:1787032281.742662:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835078144 00000100:00100000:2.0:1787032281.742673:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835078528 00000100:00100000:1.0:1787032281.742673:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835078144 00000100:00100000:3.0:1787032281.742744:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835078272 00000100:00100000:1.0:1787032281.742744:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 174 00000100:00100000:3.0:1787032281.742747:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835078272 00000100:00100000:1.0:1787032281.742754:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+18:2354:x1873838835078144:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032281.742804:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835078016 00000100:00100000:0.0:1787032281.742808:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835078016 00000100:00100000:1.0:1787032281.742835:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+18:2354:x1873838835078144:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032281.742837:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 301 00000100:00100000:0.0:1787032281.742843:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838835078016:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032281.742844:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 174 00000100:00100000:0.0:1787032281.742875:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2354:x1873838835078016:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 27us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032281.742882:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 301 00000100:00100000:0.0:1787032281.743107:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835078400 00000100:00100000:0.0:1787032281.743112:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835078400 00000100:00100000:2.0:1787032281.749037:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 175 00000100:00100000:2.0:1787032281.749054:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2354:x1873838835078528:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032281.749188:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2354:x1873838835078528:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 138us (6641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032281.749197:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 175 00000100:00100000:3.0:1787032281.750964:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 106 00000100:00100000:3.0:1787032281.750979:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfadbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2354:x1873838835078272:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032281.752553:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfadbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2354:x1873838835078272:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 1567us (10038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032281.752569:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 106 00000100:00080000:1.0:1787032281.754538:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787032281.754550:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787032281.754553:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032281.758550:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 107 00000100:00100000:0.0:1787032281.758571:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835078400:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032281.758686:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+7:2354:x1873838835078400:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 121us (16064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032281.758715:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 107 00010000:00010000:2.0:1787032281.795656:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032282.738745:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032282.738904:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835078784 00000100:00100000:1.0:1787032282.738915:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835078784 00000100:00100000:1.0:1787032282.738974:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 66 00000100:00100000:1.0:1787032282.738984:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+18:12291:x1873838835078784:12345-192.168.201.48@tcp:35:umount.0 00000100:00100000:1.0:1787032282.739636:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+19:12291:x1873838835078784:12345-192.168.201.48@tcp:35:umount.0 Request processed in 651us (898us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787032282.739647:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 66 00000100:00100000:3.0:1787032282.745063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032282.745266:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835079040 00000100:00100000:1.0:1787032282.745276:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835079040 00000100:00100000:1.0:1787032282.745337:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 67 00000100:00100000:1.0:1787032282.745348:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+19:12291:x1873838835079040:12345-192.168.201.48@tcp:35:umount.0 00000100:00100000:1.0:1787032282.745793:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:12291:x1873838835079040:12345-192.168.201.48@tcp:35:umount.0 Request processed in 445us (738us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787032282.745815:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 67 00000100:00100000:3.0:1787032282.750578:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032282.750772:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835079296 00000100:00100000:1.0:1787032282.750785:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835079296 00000100:00100000:1.0:1787032282.750967:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 68 00000100:00100000:1.0:1787032282.750979:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc5f22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+20:12291:x1873838835079296:12345-192.168.201.48@tcp:35:umount.0 00000100:00100000:1.0:1787032282.752413:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc5f22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d144536-0f5d-43dc-8f25-f68546215872+21:12291:x1873838835079296:12345-192.168.201.48@tcp:35:umount.0 Request processed in 1428us (1839us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787032282.752425:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 68 00000100:00100000:3.0:1787032282.755671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032282.755763:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835079552 00000100:00100000:2.0:1787032282.755773:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835079552 00000100:00100000:2.0:1787032282.755830:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 69 00000100:00100000:2.0:1787032282.755838:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+21:12291:x1873838835079552:12345-192.168.201.48@tcp:35:umount.0 00000100:00100000:2.0:1787032282.756275:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc61c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d144536-0f5d-43dc-8f25-f68546215872+22:12291:x1873838835079552:12345-192.168.201.48@tcp:35:umount.0 Request processed in 434us (624us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787032282.756282:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 69 00000100:00100000:3.0:1787032282.762695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032282.762738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032282.762770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032282.762915:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835079680 00000100:00100000:0.0:1787032282.762925:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835079680 00000100:00100000:0.0:1787032282.762990:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835079808 00000100:00100000:0.0:1787032282.762994:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835079808 00000100:00100000:0.0:1787032282.763018:0:11533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835079936 00000100:00100000:0.0:1787032282.763022:0:11533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835079936 00000100:00100000:0.0:1787032282.763040:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:0.0:1787032282.763049:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+15:2355:x1873838835079680:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032282.763101:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032282.763123:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1e984d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26cd expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032282.763140:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032282.763194:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+14:2355:x1873838835079680:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 145us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032282.763201:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:0.0:1787032282.763231:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:0.0:1787032282.763238:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+13:2355:x1873838835079808:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032282.763245:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032282.763254:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7000/0xcd047797ef1e9815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2695 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032282.763262:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032282.763279:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:2355:x1873838835079808:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 42us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032282.763284:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:0.0:1787032282.763315:0:11533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:0.0:1787032282.763321:0:11533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+11:2354:x1873838835079936:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032282.763329:0:11533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032282.763338:0:11533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef418400/0xcd047797ef1e9a99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2798 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032282.763346:0:11533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032282.763364:0:11533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2354:x1873838835079936:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 43us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032282.763370:0:11533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:0.0:1787032282.766775:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032282.766947:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835080320 00000100:00100000:3.0:1787032282.766973:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835080320 00000100:00100000:3.0:1787032282.767033:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 73 00000100:00100000:3.0:1787032282.767043:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+7:2353:x1873838835080320:12345-192.168.201.48@tcp:9:umount.0 00000020:00000080:3.0:1787032282.767098:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9def 00000020:00010000:3.0:1787032282.767107:0:6584:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cdefc50000: total 0 00000100:00080000:3.0:1787032282.767111:0:6584:0:(import.c:65:import_set_state_nolock()) ffff99cdefc57000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787032282.767156:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787032282.767469:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d144536-0f5d-43dc-8f25-f68546215872+5:2353:x1873838835080320:12345-192.168.201.48@tcp:9:umount.0 Request processed in 426us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032282.767478:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 73 00000020:00010000:0.0:1787032282.768227:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cdefc50000: total 0 00010000:00010000:0.0:1787032282.768261:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cdefc50000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787032282.768318:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1ea829 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b3b expref: 4 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032282.768352:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5cb5eba/0xcd047797ef1ea18b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b296d expref: 3 pid: 6895 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032282.768366:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cdefc50000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787032282.768376:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032282.768378:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032282.768380:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032282.772905:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032282.772991:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835080448 00000100:00100000:0.0:1787032282.773003:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835080448 00000100:00100000:0.0:1787032282.773101:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 74 00000100:00100000:0.0:1787032282.773113:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+5:2353:x1873838835080448:12345-192.168.201.48@tcp:9:umount.0 00000020:00000080:0.0:1787032282.773178:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9b87 00000100:00080000:0.0:1787032282.773192:0:6586:0:(import.c:65:import_set_state_nolock()) ffff99cdc549c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787032282.773253:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787032282.773529:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d144536-0f5d-43dc-8f25-f68546215872+2:2353:x1873838835080448:12345-192.168.201.48@tcp:9:umount.0 Request processed in 417us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032282.773537:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 74 00010000:00010000:1.0:1787032282.773636:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032282.784625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032282.784779:0:7755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835081472 00000100:00100000:2.0:1787032282.784790:0:7755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835081472 00000100:00100000:2.0:1787032282.784865:0:7755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 240 00000100:00100000:2.0:1787032282.784875:0:7755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+22:2353:x1873838835081472:12345-192.168.201.48@tcp:39:umount.0 00000020:00000080:2.0:1787032282.784910:0:7755:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9823 00000020:00010000:2.0:1787032282.784928:0:7755:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cdfacbf000: total 0 00000100:00080000:2.0:1787032282.784933:0:7755:0:(import.c:65:import_set_state_nolock()) ffff99cdfacbf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787032282.784969:0:7755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787032282.785452:0:7755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d144536-0f5d-43dc-8f25-f68546215872+21:2353:x1873838835081472:12345-192.168.201.48@tcp:39:umount.0 Request processed in 576us (837us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787032282.785460:0:7755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 240 00000020:00010000:3.0:1787032282.786120:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cdfacbf000: total 0 00010000:00010000:3.0:1787032282.786126:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032282.786173:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cdfacbf000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787032282.786209:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdc3864400) 00010000:00010000:3.0:1787032282.786213:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032282.786234:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7400/0xcd047797ef1e9b09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27ad expref: 20 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786261:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032282.786264:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032282.786268:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537c00/0xcd047797ef1ea7ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b26 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786282:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:3.0:1787032282.786284:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787032282.786288:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536a00/0xcd047797ef1ea1ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2989 expref: 18 pid: 7755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786318:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032282.786320:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787032282.786325:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536800/0xcd047797ef1ea14c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2958 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786338:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032282.786341:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787032282.786345:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419200/0xcd047797ef1ea176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2966 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786358:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:3.0:1787032282.786360:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787032282.786364:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775a00/0xcd047797ef1ea4e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2a62 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786376:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032282.786379:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787032282.786383:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ea814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b34 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786395:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032282.786397:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787032282.786401:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1536c00/0xcd047797ef1e9e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2894 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786412:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cdc3864100) 00010000:00010000:3.0:1787032282.786415:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787032282.786426:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7a00/0xcd047797ef1e9aed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27a6 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786443:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:3.0:1787032282.786446:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787032282.786449:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc1537200/0xcd047797ef1ea209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2990 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786464:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99cdcba3a300) 00010000:00010000:3.0:1787032282.786466:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787032282.786469:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774c00/0xcd047797ef1ea06c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2920 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786484:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:3.0:1787032282.786487:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787032282.786490:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031400/0xcd047797ef1e9b5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b27c2 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786503:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032282.786506:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787032282.786509:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1ea70a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2aee expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032282.786522:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cdfacbf000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787032282.786536:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032282.786538:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032282.786540:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032282.818353:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787032282.940192:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:3.0:1787032282.940204:0:6614:0:(genops.c:906:class_export_put()) final put ffff99cdc549a800/5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:2.0:1787032282.940275:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdc549a800/5d144536-0f5d-43dc-8f25-f68546215872 for lustre-OST0000 00000020:00000080:2.0:1787032282.940340:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdc549c000 for lustre-OST0000 00010000:00010000:3.0:1787032283.841256:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032283.905882:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857079680:0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.905956:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032283.906016:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032283.906023:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857079808:0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.906052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032283.906130:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857079808 00000100:00100000:0.0:1787032283.906137:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857079808 00000100:00100000:0.0:1787032283.906189:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787032283.906210:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857079808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.906261:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857079808:12345-0@lo:400:kworker.0 Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032283.906268:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787032283.906320:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857079808:0@lo:400:kworker.0 00000100:00100000:1.0:1787032283.906472:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857079552:0@lo:400:kworker.0 00000100:00100000:1.0:1787032283.906505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032283.906537:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857080064:0@lo:400:kworker.0 00000100:00100000:1.0:1787032283.906564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032283.906594:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787032283.906600:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857079424:0@lo:400:kworker.0 00000100:00100000:1.0:1787032283.906626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032283.906646:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857079936:0@lo:400:kworker.0 00000100:00100000:1.0:1787032283.906668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787032283.906691:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787032283.906703:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857079424 00000100:00100000:1.0:1787032283.906707:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857079424 00000100:00100000:1.0:1787032283.906738:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787032283.906744:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857079424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032283.906795:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857079424:12345-0@lo:400:kworker.0 Request processed in 51us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032283.906802:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787032283.906855:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857079424:0@lo:400:kworker.0 00000100:00100000:1.0:1787032283.906875:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857080064 00000100:00100000:1.0:1787032283.906878:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857080064 00000100:00100000:1.0:1787032283.906907:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787032283.906914:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857080064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032283.906948:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857080064:12345-0@lo:400:kworker.0 Request processed in 34us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032283.906954:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1787032283.906967:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787032283.906983:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857080064:0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.907229:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857079680 00000100:00100000:0.0:1787032283.907235:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857079680 00000100:00100000:0.0:1787032283.907275:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857079552 00000100:00100000:0.0:1787032283.907278:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857079552 00000100:00100000:0.0:1787032283.907288:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787032283.907294:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857079680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.907330:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857079680:12345-0@lo:400:kworker.0 Request processed in 36us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032283.907343:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787032283.907353:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857079936 00000100:00100000:0.0:1787032283.907357:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857079936 00000100:00100000:0.0:1787032283.907370:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787032283.907374:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857079552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.907405:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857079552:12345-0@lo:400:kworker.0 Request processed in 30us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032283.907410:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787032283.907419:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787032283.907424:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857079936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.907443:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873838857079936:12345-0@lo:400:kworker.0 Request processed in 20us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032283.907448:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787032283.907474:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857079680:0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.907493:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1873838857079936:0@lo:400:kworker.0 00000100:00100000:0.0:1787032283.907502:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857079552:0@lo:400:kworker.0 00000100:00080000:1.0:1787032283.908170:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032284.420718:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787032284.420743:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857080192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032284.420828:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032284.421024:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857080192 00000100:00100000:2.0:1787032284.421033:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857080192 00000100:00100000:2.0:1787032284.421113:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787032284.421122:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857080192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032284.421160:0:6589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032284.421215:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857080192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032284.421222:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787032284.421268:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857080192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787032284.427332:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032284.427354:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857080320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032284.427425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032284.427475:0:8597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857080320 00000100:00100000:0.0:1787032284.427480:0:8597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857080320 00000100:00100000:0.0:1787032284.427517:0:8597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787032284.427522:0:8597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857080320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032284.427553:0:8597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032284.427595:0:8597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857080320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032284.427601:0:8597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787032284.427645:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857080320:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787032284.460414:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1787032284.460443:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000001:00080000:3.0:1787032284.460450:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787032284.460456:0:5819:0:(genops.c:906:class_export_put()) final put ffff99cdfacbf000/5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:3.0:1787032284.460480:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdfacbf000/5d144536-0f5d-43dc-8f25-f68546215872 for lustre-MDT0000 00000020:00000080:3.0:1787032284.460539:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdfacbf800 for lustre-MDT0000 00000001:00100000:0.0:1787032284.477046:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:0.0:1787032284.477057:0:7500:0:(genops.c:906:class_export_put()) final put ffff99cdefc50000/5d144536-0f5d-43dc-8f25-f68546215872 00000020:00000080:1.0:1787032284.477348:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefc50000/5d144536-0f5d-43dc-8f25-f68546215872 for lustre-OST0001 00000020:00000080:1.0:1787032284.477409:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdefc57000 for lustre-OST0001 00000100:00100000:3.0:1787032284.637997:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032284.638050:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032284.638125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032284.638209:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835081600 00000100:00100000:1.0:1787032284.638220:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835081600 00000100:00100000:1.0:1787032284.638286:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835081856 00000100:00100000:1.0:1787032284.638289:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835081856 00000100:00100000:1.0:1787032284.638306:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835081728 00000100:00100000:1.0:1787032284.638308:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835081728 00000100:00100000:1.0:1787032284.638328:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:1.0:1787032284.638338:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:2357:x1873838835081600:12345-192.168.201.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787032284.638348:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:2.0:1787032284.638362:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+12:2357:x1873838835081856:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032284.638372:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032284.638375:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032284.638396:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6a00/0xcd047797ef1e9a92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2791 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032284.638397:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1675400/0xcd047797ef1e98f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26e2 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032284.638424:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032284.638424:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032284.638493:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+10:2357:x1873838835081856:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 133us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032284.638501:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:2.0:1787032284.638522:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:2.0:1787032284.638529:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+9:2357:x1873838835081728:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032284.638538:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032284.638548:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1674600/0xcd047797ef1e98fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b270c expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032284.638569:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032284.642539:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:2357:x1873838835081728:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 3995us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032284.642539:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+8:2357:x1873838835081600:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 4186us (4540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032284.643715:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032284.643817:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835082112 00000100:00100000:0.0:1787032284.643829:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835082112 00000100:00100000:0.0:1787032284.643924:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 241 00000100:00100000:1.0:1787032284.643929:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:0.0:1787032284.643938:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+6:2353:x1873838835082112:12345-192.168.201.48@tcp:39:umount.0 00000020:00000080:0.0:1787032284.643987:0:5797:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e990a 00000020:00010000:0.0:1787032284.643998:0:5797:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cdc7786800: total 0 00000100:00080000:0.0:1787032284.644003:0:5797:0:(import.c:65:import_set_state_nolock()) ffff99cdc7784800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787032284.644032:0:5797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1787032284.644368:0:5786:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cdc7786800: total 0 00010000:00010000:1.0:1787032284.644422:0:5786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cdc7786800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787032284.644466:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc4f0a000) 00010000:00010000:1.0:1787032284.644470:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787032284.644479:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ea837 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b42 expref: 5 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032284.644503:0:5786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cdc7786800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787032284.644515:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032284.644517:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032284.644520:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032284.644525:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c0735b16-8786-4fbb-9d5e-05dc9dc09a65+3:2353:x1873838835082112:12345-192.168.201.48@tcp:39:umount.0 Request processed in 587us (812us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787032284.644535:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 241 00000100:00080000:3.0:1787032284.644954:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032284.651223:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:3.0:1787032284.672733:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032284.672934:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835082368 00000100:00100000:2.0:1787032284.672946:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835082368 00000100:00100000:2.0:1787032284.673018:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 303 00000100:00100000:2.0:1787032284.673028:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+7:2353:x1873838835082368:12345-192.168.201.48@tcp:251:umount.0 00000020:00000080:2.0:1787032284.673119:0:5791:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9800 00000020:00010000:2.0:1787032284.673128:0:5791:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cdefc22800: total 0 00000100:00080000:2.0:1787032284.673133:0:5791:0:(import.c:65:import_set_state_nolock()) ffff99cdefc24000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787032284.673225:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a+3:2353:x1873838835082368:12345-192.168.201.48@tcp:251:umount.0 Request processed in 198us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032284.673233:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 303 00000020:00010000:3.0:1787032284.674124:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cdefc22800: total 0 00010000:00010000:3.0:1787032284.674131:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032284.674194:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cdefc22800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787032284.674231:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7774800/0xcd047797ef1e9854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b26d4 expref: 2 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032284.674249:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cdefc22800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787032284.674259:0:5785:0:(genops.c:906:class_export_put()) final put ffff99cdefc22800/0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a 00010000:00010000:3.0:1787032284.674279:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032284.674281:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032284.674283:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787032284.674327:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefc22800/0b65ce4d-e6a2-4f1b-acab-90ca8fc7674a for MGS 00000020:00000080:1.0:1787032284.674369:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdefc24000 for MGS 00010000:00010000:1.0:1787032284.866447:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032285.889202:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787032286.536412:0:12882:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787032286.562625:0:12882:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787032286.562674:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562687:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562706:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562713:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562741:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787032286.562747:0:12882:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787032286.562772:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032286.562777:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562785:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775400 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032286.562789:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562797:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032286.562805:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032286.562810:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787032286.562812:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787032286.562814:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787032286.562852:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562859:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032286.562900:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562908:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1e9893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e989a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.562920:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032286.562921:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032286.562923:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787032286.562937:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787032286.562941:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787032286.562947:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787032286.562961:0:12882:0:(import.c:65:import_set_state_nolock()) ffff99cdefdb7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787032286.562986:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787032286.563004:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857080448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032286.563091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032286.564463:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff65d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838857080576:0@lo:39:umount.0 00000100:00100000:1.0:1787032286.564517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032286.566975:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857080576 00000100:00100000:2.0:1787032286.566989:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857080576 00000100:00100000:2.0:1787032286.567060:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787032286.567102:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873838857080576:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787032286.567134:0:5798:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e960f 00000100:00080000:2.0:1787032286.567144:0:5798:0:(import.c:65:import_set_state_nolock()) ffff99ce011f0800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787032286.567668:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1873838857080576:12345-0@lo:39:umount.0 Request processed in 160us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032286.567681:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787032286.567693:0:5798:0:(genops.c:906:class_export_put()) final put ffff99ce011f5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787032286.567726:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99ce011f5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787032286.568007:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ce011f0800 for lustre-MDT0000 00000100:00080000:2.0:1787032286.568107:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdefdb7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787032286.568118:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff65d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838857080576:0@lo:39:umount.0 00000100:00080000:1.0:1787032286.568708:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787032286.568713:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787032286.568719:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787032286.569485:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857080448 00000100:00100000:0.0:1787032286.569496:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857080448 00000100:00100000:0.0:1787032286.569560:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787032286.569570:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef12a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857080448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787032286.569865:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032286.569888:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ce02047600/0xcd047797ef1e989a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9893 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.569906:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032286.569997:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef12a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0402f217-6678-4505-97bf-ca0cb32c7313+18:3305:x1873838857080448:12345-0@lo:103:ldlm_bl.0 Request processed in 428us (6906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032286.570005:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787032286.570725:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857080448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032286.570953:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032286.575129:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.575162:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.575169:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.575196:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.575217:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787032286.575224:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.575230:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.575236:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.575242:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575694:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787032286.575703:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575722:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ce02046a00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:3.0:1787032286.575727:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575746:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032286.575754:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032286.575760:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787032286.575763:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787032286.575800:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575807:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787032286.575831:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575838:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99ce02046a00/0xcd047797ef1e98a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e98a8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575853:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032286.575857:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575863:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774a00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:3.0:1787032286.575866:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575885:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032286.575892:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032286.575897:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787032286.575900:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1787032286.575911:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575917:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787032286.575932:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.575940:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032286.575942:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032286.575944:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032286.575961:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857080704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787032286.576031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032286.576112:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787032286.576120:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857080832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787032286.576156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032286.576186:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857080704 00000100:00100000:3.0:1787032286.576193:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857080704 00000100:00100000:3.0:1787032286.576242:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857080832 00000100:00100000:3.0:1787032286.576246:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857080832 00010000:00010000:0.0:1787032286.577114:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032286.577362:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787032286.577373:0:12882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1e97ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e97c1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032286.577392:0:12882:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787032286.577402:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.577410:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.577417:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.577438:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.577463:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787032286.577469:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.577476:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.577482:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.577488:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032286.577499:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787032286.577502:0:12882:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787032286.577505:0:12882:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787032286.577536:0:12882:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787032286.577541:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787032286.577546:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032286.577551:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1787032286.577557:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cdff7c9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787032286.577563:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99cdeed14000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787032286.577569:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff99cdc7786800 c0735b16-8786-4fbb-9d5e-05dc9dc09a65 192.168.201.48@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787032286.577574:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff99cdefda3380) has exports, disconnecting them 00000100:00100000:3.0:1787032286.577707:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787032286.577720:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3305:x1873838857080704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787032286.577836:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787032286.577842:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.577850:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030800 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032286.577853:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.577861:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032286.577868:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032286.577872:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787032286.577875:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787032286.577877:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787032286.577906:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.577912:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032286.577931:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.577938:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0030800/0xcd047797ef1e9abc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9ac3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.577959:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032286.577962:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.577968:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1674a00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032286.577971:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.577977:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032286.577983:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032286.577988:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787032286.577990:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787032286.577992:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787032286.578015:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.578021:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032286.578036:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.578043:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1674a00/0xcd047797ef1e956e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9575 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032286.578055:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032286.578056:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032286.578064:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032286.578115:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857080960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032286.578184:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032286.578226:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857081088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032286.578250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787032286.578697:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032286.578716:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ce02046000/0xcd047797ef1e98a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e98a1 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.578732:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032286.578871:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+18:3305:x1873838857080704:12345-0@lo:103:ldlm_bl.0 Request processed in 1154us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032286.578881:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787032286.578903:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857080960 00000100:00100000:3.0:1787032286.578909:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857080960 00000100:00100000:3.0:1787032286.578933:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857081088 00000100:00100000:3.0:1787032286.578936:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857081088 00000100:00100000:3.0:1787032286.578948:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787032286.578954:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+19:3303:x1873838857080832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032286.578961:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032286.578970:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ce02047000/0xcd047797ef1e97c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e97ba expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.578982:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032286.579023:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+18:3303:x1873838857080832:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032286.579030:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787032286.579047:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787032286.579052:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+17:3303:x1873838857080960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032286.579059:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032286.579088:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef418600/0xcd047797ef1e9ac3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9abc expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.579111:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032286.579135:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+16:3303:x1873838857080960:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032286.579141:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787032286.579165:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787032286.579172:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+15:3304:x1873838857081088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032286.579179:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032286.579188:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0030400/0xcd047797ef1e9575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e956e expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032286.579199:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032286.579220:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0402f217-6678-4505-97bf-ca0cb32c7313+14:3304:x1873838857081088:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032286.579226:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00080000:1.0:1787032286.579409:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cdff7c9800), last request at 1787032283 00000020:00000080:1.0:1787032286.579421:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9782 00000100:00080000:1.0:1787032286.579439:0:12882:0:(import.c:65:import_set_state_nolock()) ffff99cdff7cb800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787032286.579499:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cdff7c9800): rc 0 00000020:00000080:1.0:1787032286.579501:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdff7c9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787032286.579510:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99cdeed14000), last request at 1787032283 00000020:00000080:1.0:1787032286.579513:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e96a9 00000100:00080000:1.0:1787032286.579519:0:12882:0:(import.c:65:import_set_state_nolock()) ffff99cdeed10800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787032286.579526:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cdeed14000): rc 0 00000020:00000080:1.0:1787032286.579527:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdeed14000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787032286.579535:0:12882:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6d1c1b17ae0 00000100:00080000:1.0:1787032286.579557:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787032286.579561:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787032286.579574:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787032286.579708:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857081088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032286.579821:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857080704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787032286.579845:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787032286.579916:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdff7c9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787032286.579959:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdeed14000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787032286.579992:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdff7cb800 for lustre-MDT0000 00000020:00000080:2.0:1787032286.579996:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdeed10800 for lustre-MDT0000 00000100:00100000:2.0:1787032286.580019:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857080960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787032286.580028:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0402f217-6678-4505-97bf-ca0cb32c7313:3303:1873838857080832:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787032286.580205:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787032286.580226:0:12882:0:(import.c:65:import_set_state_nolock()) ffff99ccc1d84000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787032286.580344:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857081216:0@lo:9:umount.0 00000100:00100000:0.0:1787032286.580391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787032286.580481:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787032286.580485:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787032286.580495:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787032286.580551:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787032286.580561:0:12882:0:(import.c:65:import_set_state_nolock()) ffff99cdc7780000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787032286.580668:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032286.580830:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857081344:0@lo:9:umount.0 00000100:00100000:0.0:1787032286.580867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032286.580910:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857081216 00000100:00100000:0.0:1787032286.580915:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857081216 00000100:00100000:2.0:1787032286.580983:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857081344 00000100:00100000:2.0:1787032286.580987:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857081344 00000020:00080000:1.0:1787032286.581048:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99cdefda3380) has no exports 00000100:00100000:0.0:1787032286.581208:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787032286.581217:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873838857081216:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787032286.581241:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9712 00000100:00080000:0.0:1787032286.581249:0:6584:0:(import.c:65:import_set_state_nolock()) ffff99cdefa98800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787032286.581291:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787032286.581650:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3301:x1873838857081216:12345-0@lo:9:umount.0 Request processed in 433us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032286.581657:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1787032286.581679:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787032286.581703:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99ccc1d84000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787032286.581713:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787032286.581715:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787032286.581746:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857081216:0@lo:9:umount.0 00000100:00080000:3.0:1787032286.582130:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787032286.582135:0:5793:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787032286.582425:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787032286.582433:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873838857081344:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787032286.582453:0:6586:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e97eb 00000100:00080000:2.0:1787032286.582460:0:6586:0:(import.c:65:import_set_state_nolock()) ffff99cdefc20800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787032286.582487:0:6586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787032286.582881:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3301:x1873838857081344:12345-0@lo:9:umount.0 Request processed in 448us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032286.582889:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787032286.583054:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc7780000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787032286.583094:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787032286.583096:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787032286.583100:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857081344:0@lo:9:umount.0 00010000:00010000:3.0:1787032286.583195:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787032286.591446:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99cdefda3380) has no exports 00000020:00000080:2.0:1787032286.649722:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e95c9 00000020:00000080:2.0:1787032286.649740:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdf4a61000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787032286.649757:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787032286.649851:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdf4a61000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787032286.649873:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787032286.649882:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787032286.649885:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff99cdc7650000) has no exports 00000020:00000080:2.0:1787032286.650225:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e95c2 00000020:00000080:2.0:1787032286.650234:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdefa86800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787032286.650313:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787032286.650337:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787032286.650340:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdefa87000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787032286.650342:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefa87000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787032286.650352:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787032286.650541:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefa86800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787032286.923737:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032287.937266:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787032288.092515:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787032288.092526:0:6614:0:(genops.c:906:class_export_put()) final put ffff99cdefa9c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787032288.092698:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefa9c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787032288.092748:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdefa98800 for lustre-OST0000 00010000:00010000:0.0:1787032288.961632:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032289.025630:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857081472:0@lo:400:kworker.0 00000100:00100000:0.0:1787032289.025715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032289.025835:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857081472 00000100:00100000:3.0:1787032289.025844:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857081472 00000100:00100000:3.0:1787032289.025901:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787032289.025910:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:3305:x1873838857081472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032289.025965:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc8cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0402f217-6678-4505-97bf-ca0cb32c7313+14:3305:x1873838857081472:12345-0@lo:400:kworker.0 Request processed in 57us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032289.025988:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787032289.026058:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0402f217-6678-4505-97bf-ca0cb32c7313:3305:1873838857081472:0@lo:400:kworker.0 00000100:00100000:2.0:1787032289.027550:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857081600:0@lo:400:kworker.0 00000100:00100000:2.0:1787032289.027609:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032289.027650:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032289.027657:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857081728:0@lo:400:kworker.0 00000100:00100000:2.0:1787032289.027681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032289.028251:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857081600 00000100:00100000:0.0:1787032289.028261:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857081600 00000100:00100000:0.0:1787032289.028305:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857081728 00000100:00100000:0.0:1787032289.028309:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857081728 00000100:00100000:0.0:1787032289.028489:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787032289.028497:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1873838857081600:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787032289.028506:0:5799:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787032289.028557:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1873838857081600:12345-0@lo:400:kworker.0 Request processed in 60us (948us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787032289.028565:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787032289.028580:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787032289.028584:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1873838857081728:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787032289.028589:0:5799:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787032289.028609:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1873838857081728:12345-0@lo:400:kworker.0 Request processed in 23us (927us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787032289.028614:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787032289.033459:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787032289.033470:0:3302:0:(import.c:65:import_set_state_nolock()) ffff99cdfacba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787032289.033476:0:3302:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787032289.041971:0:3302:0:(import.c:65:import_set_state_nolock()) ffff99cdfacba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787032289.041988:0:3302:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 250 00000100:00080000:2.0:1787032289.041999:0:3302:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cdfacba000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:2.0:1787032289.042045:0:3302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdfb136d80 x1873838857081856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787032289.042175:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1873838857081856:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787032289.042248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032289.042399:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857081728:0@lo:400:kworker.0 00000100:00080000:2.0:1787032289.042434:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787032289.042438:0:3302:0:(import.c:65:import_set_state_nolock()) ffff99cdffa3c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787032289.042442:0:3302:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787032289.042447:0:3302:0:(import.c:65:import_set_state_nolock()) ffff99cdffa3c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787032289.042450:0:3302:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 233 00000100:00080000:2.0:1787032289.042455:0:3302:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cdffa3c800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:2.0:1787032289.042487:0:3302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdfb134700 x1873838857081984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787032289.042526:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1873838857081984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787032289.042560:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857081856 00000100:00100000:3.0:1787032289.042567:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032289.042569:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857081856 00000100:00100000:3.0:1787032289.042605:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857081984 00000100:00100000:3.0:1787032289.042610:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857081984 00000100:00100000:3.0:1787032289.042644:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787032289.042653:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1873838857081984:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1787032289.042672:0:5797:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787032289.042844:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787032289.042850:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1873838857081856:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787032289.042859:0:5799:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787032289.042905:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1873838857081856:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 54us (656us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787032289.042913:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787032289.043638:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdfacba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787032289.043646:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787032289.043650:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1873838857081856:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787032289.044298:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857081600:0@lo:400:kworker.0 00000100:00100000:3.0:1787032289.055581:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1873838857081984:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 12923us (13009us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787032289.055596:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787032289.055701:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdffa3c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787032289.055720:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787032289.055725:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1873838857081984:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1787032289.576479:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787032289.576492:0:7500:0:(genops.c:906:class_export_put()) final put ffff99cdefc26800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787032289.576568:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefc26800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787032289.576624:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdefc20800 for lustre-OST0001 00000001:00100000:2.0:1787032289.582752:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00000001:00080000:2.0:1787032289.582772:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787032289.582778:0:5819:0:(genops.c:906:class_export_put()) final put ffff99cdc7786800/c0735b16-8786-4fbb-9d5e-05dc9dc09a65 00000020:00000080:1.0:1787032289.582853:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdc7786800/c0735b16-8786-4fbb-9d5e-05dc9dc09a65 for lustre-MDT0000 00000020:00000080:1.0:1787032289.582947:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdc7784800 for lustre-MDT0000 00010000:00010000:3.0:1787032289.985583:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032291.009317:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032292.034631:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787032292.737247:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cdfaf843c0 - data ffff99cdffc65d80/ffff99cdffab5400 00000020:01000000:2.0:1787032292.737395:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cdcb7b7900 - data ffff99cddebaaa20/ffff99cdefd51c00 00000001:00000004:2.0:1787032292.743499:0:12882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1787032292.846825:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787032292.846836:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1787032292.846869:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787032292.846872:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787032292.851270:0:6611:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787032292.851283:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1787032292.851303:0:6611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787032292.855082:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787032292.855092:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1787032292.855120:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787032292.855124:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787032292.858757:0:7949:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787032292.858769:0:7949:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787032292.858786:0:7949:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787032292.943582:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9591 00000020:00000080:1.0:1787032292.943595:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdefdb0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787032292.943682:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefdb0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787032292.944976:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e95a6 00000020:00000080:1.0:1787032292.944987:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdefdb7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787032292.945012:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787032292.945017:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032292.945026:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787032292.945041:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99cdefda4d40) has no exports 00000004:01000000:1.0:1787032292.945231:0:12882:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787032292.945239:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e97e4 00000020:00000080:1.0:1787032292.945243:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdc7786000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787032292.945248:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787032292.945252:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032292.945258:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787032292.945261:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff99cdc8183380) has no exports 00000020:00000080:1.0:1787032292.945267:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e97dd 00000020:00000080:1.0:1787032292.945270:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdc7787000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787032292.945624:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787032292.945629:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787032292.945643:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787032292.945650:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787032292.945653:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787032292.945686:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787032292.945693:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787032292.945698:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e96ef 00000020:00000080:1.0:1787032292.945702:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdff7cc800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787032292.945705:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787032292.945709:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032292.945712:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787032292.945715:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99cdc76f99c0) has no exports 00000020:00000080:1.0:1787032292.945719:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e96e8 00000020:00000080:1.0:1787032292.945721:0:12882:0:(genops.c:906:class_export_put()) final put ffff99ccc1d82800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787032292.946105:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787032292.946108:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787032292.946111:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787032292.946116:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787032292.946118:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787032292.946150:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787032292.946156:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787032292.946187:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787032292.946191:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787032292.946217:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e95ad 00000020:00000080:1.0:1787032292.946221:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdefdb1800/lustre-MDD0000_UUID 00000020:01000000:1.0:1787032292.946226:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787032292.946229:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032292.946233:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787032292.946235:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff99cdefda0000) has no exports 00000020:00000080:1.0:1787032292.946259:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787032292.946263:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787032292.946266:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e95b4 00000020:00000080:1.0:1787032292.946269:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdefdb4800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787032292.946286:0:12882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cde4b73800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787032292.946290:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cde4b73800 3 00000020:01000004:1.0:1787032292.946293:0:12882:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cde4b73800 from lustre-MDT0000 00000020:00000080:1.0:1787032292.946316:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787032292.946319:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787032292.946322:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdefdb2000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787032292.946325:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefdb2000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787032292.946338:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1787032292.946405:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefdb7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787032292.946410:0:8:0:(genops.c:906:class_export_put()) final put ffff99ce011f4000/lustre-MDT0000-mdtlov_UUID 00000020:01000004:1.0:1787032292.946411:0:12882:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:00000080:2.0:1787032292.946412:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99ce011f4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000004:1.0:1787032292.946414:0:12882:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787032292.946416:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787032292.946417:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787032292.946420:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032292.946422:0:12882:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787032292.946428:0:12882:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99cdc9d0c800 0402f217-6678-4505-97bf-ca0cb32c7313 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787032292.946434:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff99cdc76519c0) has exports, disconnecting them 00000020:00080000:1.0:1787032292.946437:0:12882:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99cdc9d0c800), last request at 1787032063 00000020:00000080:1.0:1787032292.946450:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9552 00000020:00010000:1.0:1787032292.946454:0:12882:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99cdc9d0c800: total 7 00000100:00080000:1.0:1787032292.946457:0:12882:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d09800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787032292.946478:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cdc9d0c800): rc 0 00000020:00080000:1.0:1787032292.946482:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff99cdc76519c0) has no exports 00000020:00000080:2.0:1787032292.946520:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdc7786000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787032292.946525:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdc7787000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787032292.946530:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdc7780000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787032292.946533:0:8:0:(genops.c:906:class_export_put()) final put ffff99cdfadaf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787032292.946535:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdfadaf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787032292.946538:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:1.0:1787032292.946542:0:5790:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99cdc8c82e00:5790] 0 exiting: rc = 1 00000020:00000080:2.0:1787032292.946562:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdff7cc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787032292.946567:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc1d82800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787032292.946570:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99ccc1d84000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787032292.946580:0:8:0:(genops.c:906:class_export_put()) final put ffff99cdffa3e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787032292.946583:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdffa3e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787032292.946586:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787032292.946648:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefdb1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787032292.946652:0:8:0:(genops.c:906:class_export_put()) final put ffff99cdefdb5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787032292.946653:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefdb5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787032292.946658:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00010000:3.0:1787032292.946668:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99cdc9d0c800: total 2 00010000:00010000:3.0:1787032292.946702:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99cdc9d0c800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787032292.946732:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7775000/0xcd047797ef1e98b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e98af expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032292.946748:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0031e00/0xcd047797ef1e9870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9869 expref: 8 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032292.946769:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7775800/0xcd047797ef1e9862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e985b expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032292.946781:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7774400/0xcd047797ef1e987e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9877 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032292.946791:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc0030c00/0xcd047797ef1e988c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9885 expref: 5 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032292.946807:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1536200/0xcd047797ef1e965c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9655 expref: 4 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032292.946822:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef419800/0xcd047797ef1e9ab5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9aae expref: 3 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032292.946832:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7774e00/0xcd047797ef1e9aa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd047797ef1e9aa0 expref: 2 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032292.946842:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99cdc9d0c800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787032292.946854:0:5785:0:(genops.c:906:class_export_put()) final put ffff99cdc9d0c800/0402f217-6678-4505-97bf-ca0cb32c7313 00010000:00010000:3.0:1787032292.946864:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032292.946866:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032292.946868:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032292.947224:0:5792:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99cdc8c83400:5792] 2 exiting: rc = 0 00000020:00000080:2.0:1787032292.949911:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefdb4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787032292.949925:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdc9d0c800/0402f217-6678-4505-97bf-ca0cb32c7313 for MGS 00000100:00100000:0.0:1787032292.950197:0:5791:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99cdc8c82c00:5791] 1 exiting: rc = 0 00000100:00100000:1.0:1787032292.951786:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951796:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951803:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951809:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951815:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951820:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951825:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951835:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951842:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951868:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951874:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951880:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951886:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951893:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951899:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951917:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951924:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951930:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951936:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951941:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951947:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951952:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951958:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951964:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951969:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951975:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951981:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951986:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951992:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.951998:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952004:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952010:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952017:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952024:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952039:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952047:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952052:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952058:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952064:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952085:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952092:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952098:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952103:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952108:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952122:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952127:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952133:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952138:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952143:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952148:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952153:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952157:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952163:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952167:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952172:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952177:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952182:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952187:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952193:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952198:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952204:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952209:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952214:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032292.952220:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787032292.952635:0:12882:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787032292.952640:0:12882:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1787032292.954424:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdc9d09800 for MGS 00000020:01000000:1.0:1787032292.954942:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cdffe30000 - data ffff99cdffcfba20/ffff99cdff761000 00000020:01000000:1.0:1787032292.955132:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cdc9f56060 - data ffff99cdd781e0d8/ffff99cdc560c400 00000020:00000080:1.0:1787032292.967735:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9536 00000020:00000080:1.0:1787032292.967747:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdca0ca000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787032292.967774:0:12882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cde4b73800 from MGS, refs=2 00000020:01000004:1.0:1787032292.967778:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cde4b73800 2 00000020:01000004:1.0:1787032292.967780:0:12882:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cde4b73800 from MGS 00000020:00000080:1.0:1787032292.967804:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787032292.967811:0:12882:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787032292.967814:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdca0cc000/MGS 00000020:00000080:1.0:1787032292.967817:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdca0cc000/MGS for MGS 00000020:01000000:1.0:1787032292.967823:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1787032292.967952:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdca0ca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787032292.968004:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787032292.968018:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032292.968024:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787032292.968040:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99ce01195000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787032292.968170:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff99cdefda19c0) has exports, disconnecting them 00000020:00080000:1.0:1787032292.968176:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99ce01195000), last request at 1787032064 00000020:00000080:1.0:1787032292.968181:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9601 00000020:00080000:1.0:1787032292.968190:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99ce01195000): rc 0 00000020:00000080:1.0:1787032292.968194:0:12882:0:(genops.c:906:class_export_put()) final put ffff99ce01195000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787032292.976223:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99ce01195000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787032292.981171:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787032292.981181:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787032292.981186:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787032292.981194:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787032292.981370:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787032292.981380:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787032292.981388:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cde4b73800 1 00000020:00000080:2.0:1787032292.981396:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9528 00000020:00000080:2.0:1787032292.981407:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdca0c8000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787032292.981413:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787032292.981419:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787032292.981423:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787032292.981427:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99cdc8180000) has no exports 00000020:00000080:3.0:1787032292.981556:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdefdb7800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787032292.981563:0:8:0:(genops.c:906:class_export_put()) final put ffff99cdefdb4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787032292.981566:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefdb4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787032292.981577:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787032292.981633:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdca0c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787032293.044875:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787032293.044904:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787032293.044910:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cde4b73000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787032293.044915:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff99cde4b73000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787032293.044926:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787032293.045097:0:12882:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cde4b74800 00000020:01000000:3.0:1787032293.045125:0:12882:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787032293.045131:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787032293.045136:0:12882:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787032293.045140:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff99cdc7653380) has no exports 00000100:00100000:3.0:1787032293.046806:0:5797:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff99cdc8cb8800:5797] 0 exiting: rc = 1 00000100:00100000:0.0:1787032293.051020:0:5799:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff99cdc8cb8c00:5799] 2 exiting: rc = 0 00000100:00100000:1.0:1787032293.051416:0:7755:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99cdffa4b600:7755] 3 exiting: rc = 0 00000100:00100000:0.0:1787032293.063917:0:5798:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff99cdc8cb8000:5798] 1 exiting: rc = 0 00000100:00100000:3.0:1787032293.063993:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064002:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064007:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064012:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064018:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064023:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064039:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064139:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064150:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064156:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064162:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064168:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064177:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064183:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064190:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064195:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064201:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064205:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064212:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064218:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064224:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064230:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064235:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064241:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064263:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064268:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064274:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064279:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064284:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064300:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064306:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064313:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064319:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064325:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064331:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064336:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064342:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064348:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064354:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064360:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064367:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064373:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064379:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064385:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064394:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064400:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064407:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064413:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064419:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064424:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064430:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064438:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064445:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064451:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064456:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064462:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064469:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064475:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064480:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064495:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064500:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064506:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064512:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.064518:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1787032293.069345:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032293.069826:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99cdc9981800:5801] 1 exiting: rc = 0 00000100:00100000:3.0:1787032293.070060:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99cdc8c83a00:5800] 0 exiting: rc = 1 00000100:00100000:2.0:1787032293.070136:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070142:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070146:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070152:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070167:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070171:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070175:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070179:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070183:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070186:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070190:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070194:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070200:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070207:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070213:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070218:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070238:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070251:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070265:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070274:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070282:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070291:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070368:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070378:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070385:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070393:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070402:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070418:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070429:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070438:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070533:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070539:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070543:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070548:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070555:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070560:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070565:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070569:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070574:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070587:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070592:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070597:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070602:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070607:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070612:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070616:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070621:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070625:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070630:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070634:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070639:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070643:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070647:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070652:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070656:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070661:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070665:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070669:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070673:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070677:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070682:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070686:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070691:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.070696:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.080120:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99cdc8cc3e00:5803] 1 exiting: rc = 0 00000100:00100000:2.0:1787032293.083493:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99cdc5f24000:5802] 0 exiting: rc = 1 00000100:00100000:3.0:1787032293.083610:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083633:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083641:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083653:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083660:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083671:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083680:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083687:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083696:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083704:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083712:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083720:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083727:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083749:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083923:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083931:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083939:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083952:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083961:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.083973:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084015:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084024:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084042:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084051:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084062:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084146:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084156:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084180:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084191:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084201:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084213:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084234:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084244:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084255:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084261:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084267:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084273:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084544:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084554:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084560:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084567:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084620:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084626:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084632:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084638:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084644:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084651:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084657:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084665:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084694:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084703:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084711:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084720:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084727:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084733:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084741:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084750:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084758:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084768:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084780:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084790:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084799:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084817:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787032293.084872:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119045:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99cdc76e4800:5805] 1 exiting: rc = 0 00000100:00100000:2.0:1787032293.119175:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99cdc8cc3600:5804] 0 exiting: rc = 1 00000100:00100000:2.0:1787032293.119234:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119242:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119247:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119252:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119257:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119263:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119269:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119290:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119308:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119315:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119320:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119325:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119331:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119336:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119341:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119346:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119352:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119358:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119363:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119368:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119373:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119377:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119383:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119388:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119393:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119397:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119403:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119407:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119412:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119417:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119422:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119428:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119433:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119439:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119445:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119451:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119455:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119460:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119476:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119482:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119487:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119491:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119506:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119511:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119516:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119522:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119528:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119533:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119538:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119543:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119548:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119554:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119561:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119566:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119570:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119575:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119581:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119586:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119591:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119596:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119601:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119606:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119611:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119617:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.119901:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99cdc8ca7000:5806] 0 exiting: rc = 1 00000100:00100000:1.0:1787032293.120043:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99cdc8ca7200:5807] 1 exiting: rc = 0 00000100:00100000:2.0:1787032293.120421:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120428:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120433:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120438:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120443:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120448:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120453:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120458:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120520:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120528:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120534:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120539:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120554:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120559:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120564:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120569:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120574:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120579:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120584:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120588:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120593:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120598:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120603:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120607:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120612:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120617:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120621:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120625:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120630:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120634:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120638:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120642:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120646:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120650:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120655:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120660:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120665:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120669:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120674:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120680:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120685:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120689:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120694:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120699:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120703:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120708:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120713:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120726:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120731:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120736:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120740:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120745:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120750:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120755:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120761:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120767:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120772:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120778:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120783:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120789:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120795:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120800:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120806:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032293.120813:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.132632:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99cdc8ca7a00:5809] 1 exiting: rc = 0 00000100:00100000:3.0:1787032293.134218:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff99cdc8ca7800:5808] 0 exiting: rc = 1 00000100:00100000:1.0:1787032293.134416:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134423:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134429:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134434:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134439:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134444:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134449:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134453:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134459:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134463:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134480:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134486:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134490:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134495:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134501:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134506:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134511:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134516:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134524:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134529:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134533:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134554:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134559:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134563:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134568:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134573:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134578:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134582:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134587:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134591:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134597:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134602:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134607:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134612:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134616:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134621:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134626:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134632:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134637:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134643:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134648:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134653:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134657:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134663:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134669:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134674:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134679:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134684:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134688:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134693:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134698:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134702:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134707:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134712:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134717:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134722:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134734:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134739:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134743:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134748:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134752:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134757:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134761:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.134766:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.135270:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99cdc5f55e00:5811] 1 exiting: rc = 0 00000100:00100000:1.0:1787032293.135697:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99cdc5f55800:5812] 2 exiting: rc = 0 00000100:00100000:3.0:1787032293.135933:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff99cdc5f55200:5810] 0 exiting: rc = 1 00000100:00100000:1.0:1787032293.136234:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136260:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136267:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136273:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136279:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136285:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136291:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136369:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136377:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136383:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136388:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136394:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136399:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136404:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136410:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136415:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136420:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136425:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136431:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136435:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136441:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136447:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136453:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136458:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136464:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136552:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136560:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136566:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136571:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136577:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136583:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136589:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136595:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136600:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136606:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136610:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136615:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136620:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136625:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136630:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136636:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136643:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136649:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136656:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136662:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136668:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136673:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136679:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136686:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136705:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136712:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136718:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136724:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136731:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136738:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136744:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136750:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136755:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136761:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136767:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136781:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136786:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136791:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032293.136805:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787032293.151882:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787032293.151899:0:12882:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787032293.151907:0:12882:0:(genops.c:906:class_export_put()) final put ffff99cdca0c8800/MDS_uuid 00000020:00000080:1.0:1787032293.151911:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdca0c8800/MDS_uuid for MDS 00000020:01000000:1.0:1787032293.151917:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787032293.152733:0:12882:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787032294.083249:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787032294.145287:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787032294.145297:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787032294.145303:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cdffa3c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787032294.145315:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1787032294.145323:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787032294.145338:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cdffa3c800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:0.0:1787032294.145344:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857082112:0@lo:400:kworker.0 00000100:00100000:3.0:1787032294.145375:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc3691500 x1873838857082240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787032294.145407:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787032294.145411:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787032294.145414:0:38:0:(import.c:65:import_set_state_nolock()) ffff99cdfacba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000400:00000100:0.0:1787032294.145426:0:3304:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873838857082112 offset 0 length 224: 4 00000100:00080000:3.0:1787032294.145435:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1787032294.145439:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787032294.145446:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cdfacba000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:3.0:1787032294.145476:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc3691c00 x1873838857082368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787032294.145542:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1873838857082240:0@lo:38:kworker.0 00000400:00000100:3.0:1787032294.145600:0:3301:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873838857082240 offset 0 length 520: 4 00000100:00100000:2.0:1787032294.145697:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1873838857082368:0@lo:38:kworker.0 00000400:00000100:2.0:1787032294.145733:0:3301:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873838857082368 offset 0 length 520: 4 00010000:00010000:3.0:1787032295.106472:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032296.129928:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787032296.275900:0:13037:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787032296.296228:0:13037:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787032296.296285:0:13037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.296301:0:13037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.296309:0:13037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.296317:0:13037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.296345:0:13037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787032296.296351:0:13037:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787032296.296375:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787032296.296388:0:13037:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccc3691500 x1873838857082240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787032309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032296.296444:0:13037:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787032296.296452:0:13037:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787032296.296458:0:13037:0:(import.c:65:import_set_state_nolock()) ffff99cdffa3c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787032296.296463:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787032296.296467:0:13037:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccc3691500 x1873838857082240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787032309 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787032296.296508:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032296.296515:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032296.296524:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774600 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032296.296527:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032296.296536:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032296.296545:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032296.296571:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787032296.296573:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787032296.296576:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787032296.296617:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032296.296624:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032296.296658:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032296.296666:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1e9877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e987e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032296.296677:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032296.296680:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032296.296681:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032296.296693:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787032296.296706:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857082496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032296.296779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032296.296837:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857082496 00000100:00100000:0.0:1787032296.296844:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857082496 00000100:00100000:0.0:1787032296.296880:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787032296.296887:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc7677450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1873838857082496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787032296.296893:0:5782:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787032296 with bad export cookie 14773064172117595474 00000100:00100000:3.0:1787032296.300880:0:13037:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787032296.306162:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1873838857082240:0@lo:38:kworker.0 00000100:00100000:3.0:1787032296.306306:0:13037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787032296.307849:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc7677450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1873838857082496:12345-0@lo:103:ldlm_bl.0 Request processed in 10954us (11062us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787032296.307862:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787032296.308012:0:13037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032296.308024:0:13037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032296.308032:0:13037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032296.308039:0:13037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032296.308063:0:13037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787032296.308093:0:13037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032296.308100:0:13037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032296.308123:0:13037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032296.308128:0:13037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032296.308140:0:13037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787032296.308144:0:13037:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787032296.308169:0:13037:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787032296.308174:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787032296.308178:0:13037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032296.308183:0:13037:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787032296.308201:0:13037:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff99cdff7c4d40) has no exports 00000020:00080000:1.0:1787032296.308227:0:13037:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff99cdff7c4d40) has no exports 00000100:00080000:0.0:1787032296.308764:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787032296.308770:0:3304:0:(import.c:65:import_set_state_nolock()) ffff99cdca0cf800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787032296.308774:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787032296.313498:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787032296.313512:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.313548:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ce02047c00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:3.0:1787032296.313552:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.313563:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032296.313570:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032296.313576:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787032296.313578:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787032296.313582:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000000:1.0:1787032296.314540:0:13037:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cdf4cc8f60 - data ffff99cdffc28a20/ffff99cdfac9b800 00000020:01000000:1.0:1787032296.314691:0:13037:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cdffe252a0 - data ffff99cdd7ac7000/ffff99ccc24e0000 00010000:00010000:2.0:1787032296.316554:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032296.316713:0:13038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032296.316721:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032296.316733:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030600 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:2.0:1787032296.316737:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032296.316747:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787032296.316775:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032296.316781:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787032296.316783:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787032296.316787:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1787032296.317488:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.148@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787032296.317500:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787032296.317509:0:3304:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccc3692d80 x1873838857082112/t0(0) o400->MGC192.168.201.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787032310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032296.317522:0:3304:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cdef890380 x1873838857082496/t0(0) o103->MGC192.168.201.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787032312 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787032296.317532:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787032296.317534:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787032296.317536:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:3.0:1787032296.317715:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.317724:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787032296.317752:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.317760:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99ce02047c00/0xcd047797ef1e9885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e988c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032296.317777:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032296.317780:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032296.317781:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032296.317799:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:0:1873838857082624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032296.317837:0:13038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032296.317839:0:13038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032296.317899:0:5786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032296.317906:0:5786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787032296.317927:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032296.317934:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0030600/0xcd047797ef1e9aae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd047797ef1e9ab5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032296.317945:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032296.317946:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032296.317948:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032296.317954:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032296.317960:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0402f217-6678-4505-97bf-ca0cb32c7313:0:1873838857082752:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787032296.318061:0:3304:0:(import.c:65:import_set_state_nolock()) ffff99cdca0cf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787032296.318290:0:3304:0:(import.c:510:import_select_connection()) MGC192.168.201.148@tcp: connect to NID 0@lo last attempt 218 00000100:00080000:0.0:1787032296.318298:0:3304:0:(import.c:624:import_select_connection()) MGC192.168.201.148@tcp: import ffff99cdca0cf800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:1.0:1787032296.318370:0:3304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdf4874a80 x1873838857082880/t0(0) o250->MGC192.168.201.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787032296.318414:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857082112:0@lo:400:kworker.0 00000100:00100000:1.0:1787032296.318429:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0402f217-6678-4505-97bf-ca0cb32c7313:3304:1873838857082496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787032296.318525:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0402f217-6678-4505-97bf-ca0cb32c7313:3301:1873838857082880:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1787032296.318568:0:3301:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873838857082880 offset 0 length 520: 4 00100000:10000000:1.0:1787032296.337889:0:13037:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787032296.368262:0:13037:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9678 00000020:00000080:2.0:1787032296.368273:0:13037:0:(genops.c:906:class_export_put()) final put ffff99cdff7cf800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787032296.368292:0:13037:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cdefa84800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787032296.368298:0:13037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdefa84800 2 00000020:01000004:2.0:1787032296.368301:0:13037:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cdefa84800 from lustre-OST0000 00000020:00000080:2.0:1787032296.368326:0:13037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787032296.368336:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787032296.368338:0:13037:0:(genops.c:906:class_export_put()) final put ffff99cdff7c8800/lustre-OST0000_UUID 00000020:00000080:2.0:1787032296.368341:0:13037:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdff7c8800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787032296.368367:0:13037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787032296.368670:0:13037:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787032296.368675:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787032296.368680:0:13037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787032296.368685:0:13037:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787032296.368693:0:13037:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99cdffa39800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787032296.368698:0:13037:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff99cdc76f8000) has exports, disconnecting them 00000020:00080000:2.0:1787032296.368703:0:13037:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99cdffa39800), last request at 1787032079 00000020:00000080:2.0:1787032296.368706:0:13037:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e96a2 00000020:00080000:2.0:1787032296.368716:0:13037:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cdffa39800): rc 0 00000020:00000080:2.0:1787032296.368721:0:13037:0:(genops.c:906:class_export_put()) final put ffff99cdffa39800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787032296.369101:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdff7cf800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787032296.369110:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdffa39800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787032296.371148:0:13037:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787032296.371157:0:13037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787032296.371161:0:13037:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787032296.371169:0:13037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787032296.371307:0:13037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787032296.371315:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787032296.371323:0:13037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdefa84800 1 00000020:00000080:3.0:1787032296.371329:0:13037:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9632 00000020:00000080:3.0:1787032296.371336:0:13037:0:(genops.c:906:class_export_put()) final put ffff99cdcaacc000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787032296.371342:0:13037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787032296.371347:0:13037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787032296.371351:0:13037:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787032296.371354:0:13037:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff99cdc76fb380) has no exports 00000020:00000080:0.0:1787032296.372003:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdffa3c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787032296.372011:0:38:0:(genops.c:906:class_export_put()) final put ffff99cdffa3b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787032296.372014:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdffa3b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787032296.372020:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787032296.372100:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdcaacc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787032296.382857:0:13037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787032296.382873:0:13037:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787032296.382879:0:13037:0:(genops.c:906:class_export_put()) final put ffff99cdefd9a000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787032296.382884:0:13037:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefd9a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787032296.382895:0:13037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787032296.383045:0:13037:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cdefd98000 00000020:02000400:0.0:1787032296.383116:0:13037:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787032297.154204:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032298.178917:0:13038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032299.203569:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787032299.273792:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0402f217-6678-4505-97bf-ca0cb32c7313->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787032299.273802:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0402f217-6678-4505-97bf-ca0cb32c7313->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787032299.273815:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787032299.273818:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:1.0:1787032299.322608:0:13188:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787032299.339281:0:13188:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787032299.339361:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.339374:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.339392:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.339399:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.339423:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787032299.339429:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787032299.339456:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787032299.339467:0:13188:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccc3691c00 x1873838857082368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787032309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032299.339486:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787032299.339491:0:13188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787032299.339497:0:13188:0:(import.c:65:import_set_state_nolock()) ffff99cdfacba000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787032299.339502:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787032299.339506:0:13188:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99ccc3691c00 x1873838857082368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787032309 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032299.339513:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787032299.339516:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:0.0:1787032299.339539:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1873838857082368:0@lo:38:kworker.0 00010000:00010000:3.0:1787032299.339561:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032299.339567:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032299.339575:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030200 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:3.0:1787032299.339579:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032299.339588:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032299.339596:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032299.339614:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787032299.339616:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787032299.339619:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787032299.339634:0:5785:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cdca0cf800 00010000:00010000:3.0:1787032299.339637:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032299.339644:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0030200/0xcd047797ef1e985b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd047797ef1e9862 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032299.339654:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032299.339656:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032299.339658:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032299.340498:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.340511:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.340517:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.340537:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.340554:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787032299.340560:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.340564:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.340568:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.340571:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032299.340580:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787032299.340583:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787032299.340603:0:13188:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:0.0:1787032299.340604:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000000:1.0:1787032299.340607:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1787032299.340610:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787032299.340611:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032299.340616:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1787032299.340617:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031200 already unused, calling callback (ffffffffc1b5ac20) 00000020:00080000:1.0:1787032299.340620:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99cdefc199c0) has no exports 10000000:00010000:0.0:1787032299.340620:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032299.340626:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032299.340632:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032299.340637:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787032299.340640:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00000020:00080000:1.0:1787032299.340641:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99cdefc199c0) has no exports 10000000:01000000:0.0:1787032299.340642:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787032299.340649:0:5786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cdca0cf800 00010000:00010000:0.0:1787032299.340652:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032299.340659:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc0031200/0xcd047797ef1e9869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd047797ef1e9870 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032299.340668:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032299.340671:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032299.340682:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7200 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032299.340685:0:5786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032299.340692:0:5786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032299.340698:0:5786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032299.340703:0:5786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787032299.340705:0:5786:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787032299.340706:0:5786:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787032299.340710:0:5786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cdca0cf800 00010000:00010000:0.0:1787032299.340713:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032299.340719:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc7200/0xcd047797ef1e9aa0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd047797ef1e9aa7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032299.340731:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032299.340733:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032299.340735:0:5786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787032299.342260:0:13188:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cdffe301e0 - data ffff99cdffcfb288/ffff99cde4aca400 00010000:00010000:3.0:1787032299.342296:0:13038:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787032299.342441:0:13188:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff99cdffe30d20 - data ffff99cdffd30e58/ffff99cdfb20fc00 00100000:10000000:0.0:1787032299.356907:0:13188:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787032299.378902:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9751 00000020:00000080:3.0:1787032299.378922:0:13188:0:(genops.c:906:class_export_put()) final put ffff99cdefc27800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787032299.378942:0:13188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cdc4c91800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787032299.378946:0:13188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdc4c91800 2 00000020:01000004:3.0:1787032299.378949:0:13188:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99cdc4c91800 from lustre-OST0001 00000020:00000080:3.0:1787032299.378985:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787032299.378995:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787032299.378998:0:13188:0:(genops.c:906:class_export_put()) final put ffff99cdf7478000/lustre-OST0001_UUID 00000020:00000080:3.0:1787032299.379001:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdf7478000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787032299.379008:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787032299.379136:0:13188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0402f217-6678-4505-97bf-ca0cb32c7313->MGS 00010000:00010000:3.0:1787032299.379152:0:13188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1e9655 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e965c expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032299.379164:0:13188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1e9655 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e965c expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032299.379180:0:13188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787032299.379183:0:13188:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787032299.379187:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787032299.379200:0:13188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cdca0cf800 00010000:00010000:3.0:1787032299.379204:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1e9655 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd047797ef1e965c expref: -99 pid: 6582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032299.379219:0:13188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd047797ef1e98b6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032299.379226:0:13188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd047797ef1e98b6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032299.379231:0:13188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787032299.379233:0:13188:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787032299.379235:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787032299.379242:0:13188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99cdca0cf800 00010000:00010000:3.0:1787032299.379245:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99ce02046e00/0xcd047797ef1e98af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd047797ef1e98b6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787032299.379262:0:13188:0:(import.c:65:import_set_state_nolock()) ffff99cdca0cf800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787032299.379266:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787032299.379268:0:13188:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787032299.379270:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787032299.379273:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787032299.379283:0:13188:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99cdf4874a80 x1873838857082880/t0(0) o250->MGC192.168.201.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787032306 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787032299.379305:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787032299.379308:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1787032299.379549:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdefc27800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1787032299.379884:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0402f217-6678-4505-97bf-ca0cb32c7313:3301:1873838857082880:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1787032299.379958:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787032299.379973:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9544 00000020:00000080:3.0:1787032299.379978:0:13188:0:(genops.c:906:class_export_put()) final put ffff99cdca0cb800/0402f217-6678-4505-97bf-ca0cb32c7313 00000020:01000000:3.0:1787032299.380021:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.148@tcp (flags='') 00000020:00000080:3.0:1787032299.380030:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787032299.380035:0:13188:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787032299.380038:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff99cdc7654d40) has no exports 10000000:01000000:2.0:1787032299.380359:0:5794:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787032299.380544:0:13188:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.148@tcp: client import never connected 00000100:00080000:3.0:1787032299.380548:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787032299.380550:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787032299.380552:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787032299.380554:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787032299.380615:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdca0cb800/0402f217-6678-4505-97bf-ca0cb32c7313 for MGC192.168.201.148@tcp 00000020:00000080:3.0:1787032299.380807:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787032299.380813:0:13188:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.148@tcp (uuid 0402f217-6678-4505-97bf-ca0cb32c7313) 00000020:01000000:3.0:1787032299.380819:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787032299.380836:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787032299.380840:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787032299.380846:0:13188:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99cdfacbd800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787032299.380852:0:13188:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff99cdff7c3380) has exports, disconnecting them 00000020:00080000:3.0:1787032299.380856:0:13188:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99cdfacbd800), last request at 1787032095 00000020:00000080:3.0:1787032299.380860:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e977b 00000020:00080000:3.0:1787032299.380871:0:13188:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99cdfacbd800): rc 0 00000020:00000080:3.0:1787032299.380875:0:13188:0:(genops.c:906:class_export_put()) final put ffff99cdfacbd800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787032299.381928:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdca0cf800 for MGC192.168.201.148@tcp 00000020:00000080:1.0:1787032299.381936:0:8:0:(genops.c:906:class_export_put()) final put ffff99cdca0cc800/0402f217-6678-4505-97bf-ca0cb32c7313 00000020:00000080:1.0:1787032299.381949:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdca0cc800/0402f217-6678-4505-97bf-ca0cb32c7313 for MGC192.168.201.148@tcp 00000020:01000000:1.0:1787032299.381955:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.148@tcp (0402f217-6678-4505-97bf-ca0cb32c7313) 00000020:00000080:1.0:1787032299.382251:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdfacbd800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787032299.382422:0:13188:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787032299.382426:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787032299.382431:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787032299.382436:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787032299.382582:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99cdfacba000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787032299.384206:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787032299.384413:0:5786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787032299.384536:0:13038:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787032299.384669:0:5781:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99cdd7fab000:5781] 1 exiting: rc = 0 00000100:00100000:2.0:1787032299.384741:0:5780:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99cdc893de00:5780] 0 exiting: rc = 1 00000100:00100000:2.0:1787032299.387176:0:7488:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff99cdfb203e00:7488] 2 exiting: rc = 0 00000100:00100000:1.0:1787032299.387417:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.387673:0:11533:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99cdfb183800:11533] 3 exiting: rc = 0 00000100:00100000:1.0:1787032299.387731:0:5782:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99cdd7fab400:5782] 0 exiting: rc = 1 00000100:00100000:1.0:1787032299.388282:0:5783:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99cdd7faa400:5783] 1 exiting: rc = 0 00000100:00100000:2.0:1787032299.389230:0:5784:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99cdd7fab200:5784] 2 exiting: rc = 0 00000100:00100000:1.0:1787032299.389341:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389349:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389367:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389373:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389380:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389385:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389392:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389398:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389404:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389417:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389426:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389432:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389438:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389445:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389450:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389456:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389461:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389467:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389472:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389477:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389482:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389487:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389491:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389510:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389515:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389520:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389525:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389530:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389535:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389541:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389546:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389551:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389557:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389562:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389567:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389573:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389579:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389584:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389589:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389594:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389599:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389604:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389610:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389615:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389620:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389626:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389631:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389637:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389642:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389647:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389652:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389657:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389661:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389667:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389672:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389676:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389682:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389687:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389699:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389704:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389709:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389715:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389720:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.389725:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787032299.390632:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787032299.390642:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787032299.390648:0:13188:0:(genops.c:906:class_export_put()) final put ffff99cdffa39000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787032299.390653:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdffa39000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787032299.390658:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787032299.390706:0:13188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdc4c91800 1 00000020:00000080:1.0:1787032299.390713:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcd047797ef1e9720 00000020:00000080:1.0:1787032299.390720:0:13188:0:(genops.c:906:class_export_put()) final put ffff99ccc1d85000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787032299.390740:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787032299.390745:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787032299.390749:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787032299.390753:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff99cdc8184d40) has no exports 00000020:00000080:2.0:1787032299.390845:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff99ccc1d85000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787032299.405525:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787032299.405542:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787032299.405548:0:13188:0:(genops.c:906:class_export_put()) final put ffff99cdc4c90000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787032299.405552:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdc4c90000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787032299.405559:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787032299.405745:0:13188:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99cdc4c92000 00000020:01000000:2.0:1787032299.405777:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787032299.405781:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787032299.405785:0:13188:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787032299.405788:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff99cdc81819c0) has no exports 00000020:00000080:2.0:1787032299.405808:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787032299.405813:0:13188:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787032299.405816:0:13188:0:(genops.c:906:class_export_put()) final put ffff99cdcaacd800/OSS_uuid 00000020:00000080:2.0:1787032299.405818:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff99cdcaacd800/OSS_uuid for OSS 00000020:01000000:2.0:1787032299.408711:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787032299.408870:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff99cdcb91a600:6586] 1 exiting: rc = 0 00000100:00100000:2.0:1787032299.408970:0:6895:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99cdff773c00:6895] 3 exiting: rc = 0 00000100:00100000:1.0:1787032299.409237:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff99cdcb918c00:6587] 2 exiting: rc = 0 00000100:00100000:1.0:1787032299.409288:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99cde4cd8e00:6584] 0 exiting: rc = 1 00000100:00100000:2.0:1787032299.409391:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409399:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409409:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409416:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409421:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409425:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409430:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409436:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409442:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409447:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409453:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409458:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409464:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409470:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409475:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409480:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409485:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409491:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409497:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409597:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409603:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409609:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409615:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409620:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409639:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409645:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409651:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409656:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409661:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409667:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409672:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409678:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409683:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409688:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409694:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409699:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409704:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409710:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409722:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409731:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409738:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409743:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409749:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409755:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409760:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409766:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409771:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409776:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409781:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409785:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409790:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409795:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409800:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409804:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409809:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409814:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409818:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409891:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409898:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409922:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409929:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409934:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409940:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.409946:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.411525:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99cdcb919200:6589] 1 exiting: rc = 0 00000100:00080000:3.0:1787032299.411684:0:5793:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787032299.411850:0:8597:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99cdff750000:8597] 2 exiting: rc = 0 00000100:00100000:1.0:1787032299.411908:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99cdcb91a200:6588] 0 exiting: rc = 1 00000100:00100000:2.0:1787032299.412055:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412092:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412099:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412104:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412110:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412115:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412120:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412125:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412129:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412134:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412139:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412143:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412149:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412154:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412161:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412166:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412171:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412176:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412181:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412186:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412191:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412196:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412201:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412206:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412212:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412217:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412224:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412229:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412234:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412252:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412257:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412262:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412267:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412273:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412278:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412283:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412289:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412295:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412301:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412307:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412313:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412319:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412325:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412331:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412336:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412342:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412348:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412480:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412487:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412492:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412508:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412514:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412520:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412525:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412531:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412536:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412542:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412548:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412554:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412560:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412565:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412571:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412576:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.412583:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.413945:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99cdf4f98c00:6592] 2 exiting: rc = 0 00000100:00100000:1.0:1787032299.414347:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99cdcb91b400:6590] 0 exiting: rc = 1 00000100:00100000:0.0:1787032299.414671:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99cdcb91a400:6591] 1 exiting: rc = 0 00000100:00100000:2.0:1787032299.414858:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414866:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414881:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414888:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414895:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414900:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414906:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414920:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414927:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414932:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414939:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414945:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414952:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414957:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414963:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414969:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414975:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414980:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.414986:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415011:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415018:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415023:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415028:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415034:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415040:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415045:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415051:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415057:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415063:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415260:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415266:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415272:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415277:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415283:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415288:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415302:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415309:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415314:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415321:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415327:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415332:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415339:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415344:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415439:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415446:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415451:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415457:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415463:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415468:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415473:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415478:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415485:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415490:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415496:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415573:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415580:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415586:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415592:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415598:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415604:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415610:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415617:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415624:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787032299.415630:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.422529:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99cdf4f98600:6594] 1 exiting: rc = 0 00000100:00100000:0.0:1787032299.423036:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99cdf4f98400:6593] 0 exiting: rc = 1 00000100:00100000:1.0:1787032299.423571:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423580:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423585:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423591:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423596:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423601:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423606:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423625:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423630:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423635:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423640:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423646:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423651:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423657:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423663:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423668:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423673:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423678:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423683:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423689:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423695:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423700:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423707:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423713:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423718:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423723:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423728:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423734:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423740:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423745:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423750:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423756:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423761:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423766:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423771:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423776:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423781:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423788:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423794:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423800:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423806:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423812:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423904:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423910:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423925:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423930:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423935:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423940:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423946:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423951:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423956:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423963:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423969:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423975:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423981:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423985:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423991:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.423996:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.424002:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.424007:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.424017:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.424023:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.424029:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.424035:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.429329:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99cdf4f99000:6595] 0 exiting: rc = 1 00000100:00100000:3.0:1787032299.429661:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99cdf4f99200:6596] 1 exiting: rc = 0 00000100:00100000:1.0:1787032299.430095:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430116:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430125:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430132:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430138:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430146:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430152:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430159:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430165:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430171:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430188:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430195:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430212:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430218:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430224:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430230:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430236:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430242:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430249:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430255:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430260:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430267:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430287:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430303:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430308:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430317:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430322:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430328:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430332:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430337:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430342:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430347:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430509:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430519:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430542:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430551:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430556:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430564:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430569:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430575:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430581:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430587:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430594:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430600:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430606:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430612:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430631:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430645:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430651:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430656:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430662:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430668:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430676:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430682:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430691:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430699:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430706:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430713:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430720:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430727:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430742:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430766:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430773:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787032299.430780:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787032299.445489:0:13188:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787032318.486110:0:13804:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787032328.809504:0:14218:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787032328.809511:0:14218:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787032328.809636:0:14218:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99cdf4cdf000 00000020:01000004:2.0:1787032328.809653:0:14218:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787032328.809662:0:14218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787032328.809686:0:14218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99cdc76f99c0) 00000020:00000080:2.0:1787032328.809701:0:14218:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787032328.858662:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787032328.862468:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1787032328.862855:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1787032328.862943:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1787032328.863030:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1787032328.863154:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1787032328.863243:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1787032328.863447:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787032328.863523:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1787032328.863765:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1787032328.871033:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 770: rc = 0 00100000:10000000:0.0:1787032328.871441:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 770: rc = 0 00100000:10000000:0.0:1787032328.871996:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:0.0:1787032328.872537:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787032328.872794:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787032328.873034:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:0.0:1787032328.873545:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00100000:10000000:0.0:1787032328.873797:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787032328.880999:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787032328.881309:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:0.0:1787032328.881588:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:0.0:1787032328.881844:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787032328.882133:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:0.0:1787032328.882403:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 772: rc = 0 00100000:10000000:0.0:1787032328.882897:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 652: rc = 0 00100000:10000000:0.0:1787032328.883182:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 652: rc = 0 00100000:10000000:0.0:1787032328.884955:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 652: rc = 0 00100000:10000000:0.0:1787032328.885429:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 652: rc = 0 00100000:10000000:0.0:1787032328.885694:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 652: rc = 0 00100000:10000000:0.0:1787032328.885935:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 652: rc = 0 00100000:10000000:0.0:1787032328.886291:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 652: rc = 0 00100000:10000000:0.0:1787032328.886529:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 652: rc = 0 00100000:10000000:0.0:1787032328.890367:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 652: rc = 0 00100000:10000000:0.0:1787032328.890784:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 652: rc = 0 00100000:10000000:0.0:1787032328.891032:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 652: rc = 0 00100000:10000000:0.0:1787032328.895833:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 652: rc = 0 00100000:10000000:0.0:1787032328.896148:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 652: rc = 0 00100000:10000000:0.0:1787032328.896846:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 652: rc = 0 00100000:10000000:0.0:1787032328.897509:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 652: rc = 0 00100000:10000000:0.0:1787032328.897749:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 652: rc = 0 00100000:10000000:0.0:1787032328.898004:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 652: rc = 0 00100000:10000000:0.0:1787032328.898823:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 652: rc = 0 00100000:10000000:0.0:1787032328.900016:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 652: rc = 0 00100000:10000000:0.0:1787032328.900347:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 652: rc = 0 00100000:10000000:0.0:1787032328.900616:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 652: rc = 0 00100000:10000000:0.0:1787032328.900891:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 652: rc = 0 00100000:10000000:0.0:1787032328.901180:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 652: rc = 0 00100000:10000000:0.0:1787032328.901863:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 652: rc = 0 00100000:10000000:0.0:1787032328.902509:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 652: rc = 0 00100000:10000000:0.0:1787032328.902778:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 652: rc = 0 00100000:10000000:0.0:1787032328.903028:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 652: rc = 0 00100000:10000000:0.0:1787032328.905679:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 652: rc = 0 00100000:10000000:0.0:1787032328.905975:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 652: rc = 0 00100000:10000000:0.0:1787032328.906276:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 652: rc = 0 00100000:10000000:0.0:1787032328.906543:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 652: rc = 0 00100000:10000000:0.0:1787032328.906796:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 652: rc = 0 00100000:10000000:0.0:1787032328.907271:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 776: rc = 0 00100000:10000000:2.0:1787032328.917002:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787032328.917223:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 315: rc = 0 00100000:10000000:2.0:1787032328.917439:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787032328.917508:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 315: rc = 0 00100000:10000000:2.0:1787032328.917689:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787032328.917759:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 315: rc = 0 00100000:10000000:2.0:1787032328.918153:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787032328.918222:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 312: rc = 0 00100000:10000000:2.0:1787032328.918420:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787032328.918491:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 312: rc = 0 00100000:10000000:2.0:1787032328.918678:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787032328.918747:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 312: rc = 0 00000020:00000080:2.0:1787032328.919016:0:14218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787032328.919023:0:14218:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787032328.919033:0:14218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1ea845 00000020:01000004:2.0:1787032328.919041:0:14218:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787032328.919047:0:14218:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787032328.919052:0:14218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cdf4cdf000 from MGS 00000020:01000004:2.0:1787032328.919056:0:14218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787032328.919091:0:14218:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99cdc76fcd40) 00000020:00000080:2.0:1787032328.919103:0:14218:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787032328.919153:0:14218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdf4cdf000 from MGS, refs=2 00080000:01000000:2.0:1787032328.919157:0:14218:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787032328.919163:0:14218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1ea853 00000100:00100000:2.0:1787032328.919250:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787032328.919361:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787032328.919367:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787032328.922539:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787032328.922559:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787032328.923183:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032328.923332:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787032328.923336:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787032328.923951:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787032328.923957:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787032328.924310:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787032328.924316:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787032328.924822:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032328.924826:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032328.924827:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032328.930885:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032328.930893:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032328.930913:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032328.932273:0:14218:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787032328.943733:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787032328.954729:0:14218:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787032328.954751:0:14218:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787032328.954754:0:14218:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787032328.962194:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787032328.962411:0:14218:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787032328.962520:0:14218:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787032328.963022:0:14218:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787032328.963599:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032328.963757:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787032328.963762:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787032328.974326:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787032328.974341:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787032328.974732:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787032328.974740:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787032328.975493:0:14218:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787032328.975513:0:14218:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.148@tcp' 00000020:01000004:1.0:1787032328.975515:0:14218:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787032328.975547:0:14218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.148@tcp (typ=mgc) 00000020:00000080:1.0:1787032328.975560:0:14218:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.148@tcp (ffff99cdff7c3380) 00000020:00000080:1.0:1787032328.975576:0:14218:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787032328.975650:0:14218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccc1946800@MGC192.168.201.148@tcp: add connection 192.168.201.148@tcp at head 00010000:00010000:1.0:1787032328.975803:0:14218:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.148@tcp-0 is initialized 00000040:01000000:1.0:1787032328.975810:0:14218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.148@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787032328.976236:0:14232:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787032328.980430:0:14233:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787032328.980536:0:14218:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.148@tcp (uuid 8b69d5fe-062a-4046-aadd-ee94584b57f2) 00000020:00000080:1.0:1787032328.980563:0:14218:0:(genops.c:1406:class_connect()) connect: client 8b69d5fe-062a-4046-aadd-ee94584b57f2, cookie 0xcd047797ef1ea861 00000100:00080000:1.0:1787032328.980576:0:14218:0:(import.c:510:import_select_connection()) MGC192.168.201.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787032328.980583:0:14218:0:(import.c:624:import_select_connection()) MGC192.168.201.148@tcp: import ffff99ccc1946800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:1.0:1787032328.980637:0:14218:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdf4876a00 x1873838857083008/t0(0) o250->MGC192.168.201.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787032328.980670:0:14218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8b69d5fe-062a-4046-aadd-ee94584b57f2->MGS 00000020:01000004:1.0:1787032328.980693:0:14218:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787032328.980698:0:14218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787032328.980711:0:14218:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99cdff7c0000) 00000020:00000080:1.0:1787032328.980723:0:14218:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787032328.981289:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8b69d5fe-062a-4046-aadd-ee94584b57f2:3301:1873838857083008:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787032328.981366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032328.991218:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857083008 00000100:00100000:2.0:1787032328.991234:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857083008 00000100:00100000:2.0:1787032328.991274:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787032328.991284:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1873838857083008:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787032328.991313:0:14228:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8b69d5fe-062a-4046-aadd-ee94584b57f2@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1787032328.991342:0:14228:0:(genops.c:1406:class_connect()) connect: client 8b69d5fe-062a-4046-aadd-ee94584b57f2, cookie 0xcd047797ef1ea86f 00000100:00080000:2.0:1787032329.001754:0:14228:0:(import.c:65:import_set_state_nolock()) ffff99cdffa3d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787032329.001868:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+5:3301:x1873838857083008:12345-0@lo:250:mount.lustre.0 Request processed in 10582us (20499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.001880:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032329.001999:0:3301:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787032329.002009:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.148@tcp: connect to target with instance 0 00000100:00080000:0.0:1787032329.002018:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787032329.002023:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787032329.002026:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99ccc1946800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787032329.002029:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787032329.002049:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787032329.002056:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8b69d5fe-062a-4046-aadd-ee94584b57f2:3301:1873838857083008:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787032329.009320:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787032329.009603:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787032329.009611:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787032329.017629:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787032329.017677:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787032329.018409:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787032329.018415:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787032329.021293:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787032329.021469:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787032329.021476:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787032329.022894:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787032329.022906:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787032329.090899:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787032329.091161:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787032329.091168:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787032329.094504:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787032329.094577:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787032329.095468:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787032329.095717:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787032329.095723:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787032329.096388:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787032329.096395:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787032329.097928:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787032329.098462:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787032329.098470:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787032329.099049:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787032329.099056:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787032329.100779:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787032329.101024:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787032329.101029:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787032329.102423:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787032329.102434:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787032329.119705:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787032329.119982:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787032329.119988:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787032329.121487:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787032329.121499:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787032329.122427:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787032329.122436:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787032329.123435:0:14218:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787032329.123636:0:14218:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787032329.123647:0:14218:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787032329.123917:0:14218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787032329.123958:0:14218:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.148@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787032329.123963:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787032329.123965:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787032329.123966:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787032329.123968:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787032329.123969:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787032329.123971:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787032329.123972:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787032329.123973:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787032329.123975:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787032329.123977:0:14218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787032329.123980:0:14218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787032329.123987:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787032329.123988:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787032329.123989:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787032329.123990:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787032329.123991:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787032329.123992:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787032329.123993:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787032329.123994:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787032329.123995:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787032329.123995:0:14218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787032329.124030:0:14218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787032329.124055:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787032329.124260:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032329.124362:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc80e1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787032329.124427:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857083136 00000100:00100000:1.0:1787032329.124437:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857083136 00000100:00100000:1.0:1787032329.124593:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787032329.124605:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+5:14218:x1873838857083136:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787032329.124661:0:14231:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787032329.124665:0:14231:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787032329.124668:0:14231:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787032329.125109:0:14252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787032329.125658:0:14231:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787032329.126754:0:14253:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787032329.126761:0:14253:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787032329.126764:0:14253:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787032329.126795:0:14253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787032329.127493:0:14231:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787032329.127578:0:14231:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787032329.133345:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+5:14218:x1873838857083136:12345-0@lo:253:mount.lustre.0 Request processed in 8733us (9075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.133362:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032329.134443:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083136:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787032329.134467:0:14218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787032329.134470:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787032329.134472:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787032329.134473:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032329.134474:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032329.134475:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032329.134476:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032329.134477:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787032329.134479:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787032329.134480:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032329.134481:0:14218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787032329.144844:0:14218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cdf4cdf000 from lustre-MDT0000 10000000:01000000:0.0:1787032329.144897:0:14218:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787032329.144900:0:14218:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787032329.144906:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99cdff7c3380 10000000:01000000:0.0:1787032329.144910:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787032329.144922:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff99cdff7c3380 from 1 10000000:01000000:0.0:1787032329.144943:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787032329.145000:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.145014:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.145027:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032329.145056:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef892a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787032329.145320:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032329.145381:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.145588:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857083264 00000100:00100000:2.0:1787032329.145606:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857083264 00000100:00100000:2.0:1787032329.145666:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032329.145675:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+5:14218:x1873838857083264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787032329.145691:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032329.145709:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7200/0xcd047797ef1ea87d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea876 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032329.145734:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7200/0xcd047797ef1ea87d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea876 expref: 6 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032329.145744:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7200/0xcd047797ef1ea87d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea876 expref: 6 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032329.145769:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7200, rc 0) 00000100:00100000:2.0:1787032329.145837:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+6:14218:x1873838857083264:12345-0@lo:101:mount.lustre.0 Request processed in 161us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.145844:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787032329.146104:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef892a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032329.146123:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.146144:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032329.146206:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032329.146236:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.146261:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032329.146418:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857083392 00000100:00100000:0.0:1787032329.146423:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857083392 00000100:00100000:0.0:1787032329.146448:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787032329.146456:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+6:14218:x1873838857083392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032329.146770:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+6:14218:x1873838857083392:12345-0@lo:501:mount.lustre.0 Request processed in 313us (531us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032329.146777:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787032329.146971:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083392:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787032329.147002:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787032329.147016:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.147025:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032329.147034:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cdf4cdf000 10000000:01000000:1.0:1787032329.147039:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787032329.147044:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99cdf4cdf000 10000000:01000000:1.0:1787032329.147047:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787032329.147049:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff99cdf4cdf000 from 1 10000000:01000000:1.0:1787032329.147052:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787032329.147091:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775a00/0xcd047797ef1ea884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.147099:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775a00/0xcd047797ef1ea884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.147107:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775a00/0xcd047797ef1ea884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032329.147128:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787032329.147155:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.147176:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032329.147289:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857083520 00000100:00100000:0.0:1787032329.147294:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857083520 00000100:00100000:0.0:1787032329.147315:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032329.147321:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+6:14218:x1873838857083520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787032329.147331:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032329.147346:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1536400/0xcd047797ef1ea88b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea884 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.147365:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1536400/0xcd047797ef1ea88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea884 expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.147391:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1536400/0xcd047797ef1ea88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea884 expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.147399:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536400, rc 0) 00000100:00100000:0.0:1787032329.147437:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+7:14218:x1873838857083520:12345-0@lo:101:mount.lustre.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032329.147443:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787032329.147528:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032329.147540:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775a00/0xcd047797ef1ea884 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea88b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.147548:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775a00/0xcd047797ef1ea884 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea88b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032329.147560:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787032329.147564:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775a00/0xcd047797ef1ea884 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea88b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.147570:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775a00/0xcd047797ef1ea884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea88b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032329.147576:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787032329.147580:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787032329.147585:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99cdf4cdf000 10000000:01000000:1.0:1787032329.147587:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787032329.147602:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787032329.147604:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787032329.147618:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1ea892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.147626:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1ea892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.147640:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1ea892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032329.147652:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787032329.147677:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.147704:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032329.147910:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857083648 00000100:00100000:0.0:1787032329.147915:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857083648 00000100:00100000:0.0:1787032329.147934:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787032329.147940:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+7:14218:x1873838857083648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787032329.147947:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032329.147956:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1536000/0xcd047797ef1ea899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea892 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.147969:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1536000/0xcd047797ef1ea899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea892 expref: 8 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.147977:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1536000/0xcd047797ef1ea899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea892 expref: 8 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.147983:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536000, rc 0) 00000100:00100000:0.0:1787032329.148025:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+8:14218:x1873838857083648:12345-0@lo:101:mount.lustre.0 Request processed in 85us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032329.148031:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787032329.148345:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032329.148357:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1ea892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea899 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.148365:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1ea892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea899 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032329.148419:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032329.148447:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.148474:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032329.149030:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857083776 00000100:00100000:0.0:1787032329.149037:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857083776 00000100:00100000:0.0:1787032329.149120:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787032329.149129:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+8:14218:x1873838857083776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032329.149621:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:14218:x1873838857083776:12345-0@lo:501:mount.lustre.0 Request processed in 491us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032329.149631:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787032329.149878:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032329.149927:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787032329.149973:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.150016:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.150344:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857083904 00000100:00100000:2.0:1787032329.150350:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857083904 00000100:00100000:2.0:1787032329.150390:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787032329.150398:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:14218:x1873838857083904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032329.150952:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:14218:x1873838857083904:12345-0@lo:503:mount.lustre.0 Request processed in 553us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.150961:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787032329.151187:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857083904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787032329.152202:0:14254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef893b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14254:1873838857084032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787032329.152265:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032329.152299:0:14254:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d390c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.152578:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857084032 00000100:00100000:2.0:1787032329.152584:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857084032 00000100:00100000:2.0:1787032329.152688:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787032329.152696:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:14254:x1873838857084032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032329.153246:0:14254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef893b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14254:1873838857084032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787032329.153277:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787032329.153290:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032329.153299:0:14254:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787032329.153306:0:14254:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787032329.153310:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787032329.153324:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99cdff7c19c0) 00000020:00000080:1.0:1787032329.153346:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787032329.153352:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787032329.153463:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787032329.153472:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1ea8a7 00000100:00100000:2.0:1787032329.153702:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:14254:x1873838857084032:12345-0@lo:502:llog_process_th.0 Request processed in 1004us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.153712:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00000080:1.0:1787032329.154918:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787032329.154929:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032329.154937:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032329.154940:0:14254:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787032329.154943:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787032329.154949:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032329.154950:0:14254:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787032329.154955:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787032329.154968:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99cdff7c4d40) 00000020:00000080:1.0:1787032329.154988:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787032329.154993:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787032329.154995:0:14254:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787032329.154998:0:14254:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787032329.155004:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787032329.155722:0:14254:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdf4cdf000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787032329.155740:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99cdefda19c0) 00000020:00000080:1.0:1787032329.155750:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787032329.155915:0:14254:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787032329.155924:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1ea8bc 00000020:00000080:1.0:1787032329.156054:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787032329.156061:0:14254:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787032329.156671:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd047797ef1ea8c3 00080000:01000000:1.0:1787032329.156683:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787032329.156688:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1ea8ca 00010000:00010000:2.0:1787032329.279977:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787032329.280472:0:14254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787032329.284302:0:14254:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787032329.284859:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99cdc76fb380) 00000020:00000080:2.0:1787032329.284879:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787032329.284941:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787032329.284948:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1ea8d8 00000020:00000080:3.0:1787032329.299628:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787032329.317428:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd047797ef1ea8df 00000020:00000080:3.0:1787032329.317967:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787032329.317980:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.317987:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.317989:0:14254:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787032329.317992:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787032329.317994:0:14254:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787032329.317996:0:14254:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787032329.317997:0:14254:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787032329.317999:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787032329.318001:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.318002:0:14254:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787032329.318005:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032329.318009:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.318011:0:14254:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787032329.318014:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787032329.318053:0:14254:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787032329.318107:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.318218:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.318221:0:14254:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787032329.318225:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787032329.318228:0:14254:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787032329.318232:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.318234:0:14254:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787032329.318237:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787032329.318241:0:14254:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.148@tcp to nid 0x20000c0a8c994 (192.168.201.148@tcp) 00000020:01000000:3.0:1787032329.318272:0:14254:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787032329.318275:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787032329.318289:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99cdc8180000) 00000020:00000080:3.0:1787032329.318304:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787032329.318308:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787032329.318357:0:14254:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787032329.318362:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787032329.318377:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1ea8ed 00010000:00080000:3.0:1787032329.318408:0:14254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cdc9d69000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.148@tcp at head 00010000:00010000:3.0:1787032329.318663:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787032329.323166:0:14254:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787032329.323272:0:14254:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787032329.328401:0:14254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787032329.328477:0:14254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787032329.328578:0:14254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787032329.340854:0:14258:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787032329.340863:0:14258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787032329.341695:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787032329.341709:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787032329.341738:0:14254:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787032329.341753:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1ea8f4 00000100:00080000:3.0:1787032329.341762:0:14254:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787032329.341773:0:14254:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cdc9d69000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:3.0:1787032329.341923:0:14254:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc3692a00 x1873838857084160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787032329.341994:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857084160:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787032329.342048:0:3301:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873838857084160 offset 0 length 520: 4 00000100:00080000:3.0:1787032329.342161:0:14254:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787032329.342239:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.342244:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.342247:0:14254:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787032329.342250:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787032329.342252:0:14254:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787032329.342254:0:14254:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787032329.342255:0:14254:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787032329.342257:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787032329.342260:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.342261:0:14254:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787032329.342264:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787032329.342268:0:14254:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787032329.342271:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.342273:0:14254:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787032329.342276:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787032329.342279:0:14254:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.148@tcp to nid 0x20000c0a8c994 (192.168.201.148@tcp) 00000020:01000000:3.0:1787032329.342300:0:14254:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787032329.342303:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787032329.342315:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cdc81819c0) 00000020:00000080:3.0:1787032329.342327:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787032329.342332:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787032329.342401:0:14254:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787032329.342407:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787032329.342413:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd047797ef1ea902 00010000:00080000:3.0:1787032329.342442:0:14254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cdc4c90800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.148@tcp at head 00010000:00010000:3.0:1787032329.342658:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1787032329.343106:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b69d5fe-062a-4046-aadd-ee94584b57f2:3304:1873838857084288:0@lo:400:kworker.0 00000100:00100000:2.0:1787032329.343170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032329.343235:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857084288 00000100:00100000:2.0:1787032329.343242:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857084288 00000100:00100000:2.0:1787032329.343285:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787032329.343293:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:3304:x1873838857084288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032329.343344:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:3304:x1873838857084288:12345-0@lo:400:kworker.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.343353:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787032329.343412:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8b69d5fe-062a-4046-aadd-ee94584b57f2:3304:1873838857084288:0@lo:400:kworker.0 00000040:01000000:3.0:1787032329.344422:0:14254:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787032329.344460:0:14254:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787032329.350481:0:14254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787032329.352290:0:14254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787032329.353923:0:14254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787032329.354739:0:14260:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787032329.354745:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787032329.355501:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787032329.355872:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787032329.355911:0:14254:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787032329.355929:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1ea909 00000100:00080000:3.0:1787032329.355940:0:14254:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787032329.355945:0:14254:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cdc4c90800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:3.0:1787032329.355983:0:14254:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc3692680 x1873838857084416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787032329.356088:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857084416:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787032329.356156:0:3301:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873838857084416 offset 0 length 520: 4 00000100:00080000:3.0:1787032329.356281:0:14254:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787032329.356346:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.356352:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.356354:0:14254:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787032329.356357:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032329.356360:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.356362:0:14254:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787032329.356364:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787032329.356366:0:14254:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787032329.356376:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.356379:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.356380:0:14254:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787032329.356382:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032329.356385:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.356386:0:14254:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787032329.356389:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787032329.356418:0:14254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14254:1873838857084544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032329.356488:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032329.357252:0:14254:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc3af3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.358031:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857084544 00000100:00100000:2.0:1787032329.358041:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857084544 00000100:00100000:1.0:1787032329.358202:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787032329.358223:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:14254:x1873838857084544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032329.358529:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:14254:x1873838857084544:12345-0@lo:502:llog_process_th.0 Request processed in 308us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032329.358537:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787032329.359327:0:14254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14254:1873838857084544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787032329.359380:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.359389:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.359391:0:14254:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787032329.359396:0:14254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787032329.359669:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787032329.359689:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787032329.359710:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1ea892 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea899 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.359721:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774c00/0xcd047797ef1ea892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea899 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032329.359728:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cdf4cdf000 from 1 10000000:01000000:1.0:1787032329.359731:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787032329.359763:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.359770:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.359779:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032329.359797:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857084672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787032329.359849:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.359879:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787032329.359967:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857084672 00000100:00100000:3.0:1787032329.359973:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857084672 00000100:00100000:3.0:1787032329.360009:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787032329.360017:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+9:14218:x1873838857084672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787032329.360027:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032329.360039:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea910 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032329.360055:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 10 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032329.360062:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 10 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032329.360094:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418600, rc 0) 00000100:00100000:3.0:1787032329.360132:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+10:14218:x1873838857084672:12345-0@lo:101:mount.lustre.0 Request processed in 116us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032329.360136:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787032329.360819:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857084672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032329.360834:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.360854:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032329.361757:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857084800:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787032329.361868:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.361941:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.366280:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857084800 00000100:00100000:2.0:1787032329.366294:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857084800 00000100:00100000:2.0:1787032329.366356:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787032329.366376:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+10:14218:x1873838857084800:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787032329.366405:0:14228:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787032329.366412:0:14228:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787032329.366826:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+10:14218:x1873838857084800:12345-0@lo:256:mount.lustre.0 Request processed in 460us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.366835:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787032329.369967:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857084800:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787032329.370682:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787032329.370702:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.370711:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032329.370718:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdf4cdf000 from 1 10000000:01000000:1.0:1787032329.370719:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787032329.370755:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.370759:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.370766:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032329.370783:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857084928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787032329.371009:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.371241:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.378972:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857084928 00000100:00100000:2.0:1787032329.378987:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857084928 00000100:00100000:2.0:1787032329.379062:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787032329.379088:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+10:14218:x1873838857084928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787032329.379105:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032329.379589:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea91e expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032329.379641:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 11 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032329.379653:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 11 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032329.379663:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032329.379753:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14218:x1873838857084928:12345-0@lo:101:mount.lustre.0 Request processed in 668us (8743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.379760:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787032329.379927:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857084928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032329.379947:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032329.379956:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032329.380021:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032329.380054:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.380123:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787032329.380265:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857085056 00000100:00100000:0.0:1787032329.380269:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857085056 00000100:00100000:0.0:1787032329.380300:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787032329.380308:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14218:x1873838857085056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032329.380707:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14218:x1873838857085056:12345-0@lo:501:mount.lustre.0 Request processed in 399us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032329.380715:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032329.380912:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032329.380936:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787032329.380969:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032329.380998:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdce99f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.381099:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857085184 00000100:00100000:2.0:1787032329.381102:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857085184 00000100:00100000:2.0:1787032329.382103:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787032329.382119:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14218:x1873838857085184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032329.382260:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14218:x1873838857085184:12345-0@lo:503:mount.lustre.0 Request processed in 150us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.382265:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787032329.382709:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787032329.383180:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14262:1873838857085312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032329.383238:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032329.383264:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc3af3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787032329.383362:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857085312 00000100:00100000:1.0:1787032329.383377:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857085312 00000100:00100000:1.0:1787032329.383415:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032329.383422:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14262:x1873838857085312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787032329.383816:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14262:x1873838857085312:12345-0@lo:502:llog_process_th.0 Request processed in 383us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032329.383824:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787032329.384948:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14262:1873838857085312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787032329.384999:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032329.385011:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.385014:0:14262:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787032329.385021:0:14262:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdf4cdf000 00000020:00000080:3.0:1787032329.385023:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787032329.385030:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.385032:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.385032:0:14262:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787032329.385034:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032329.385035:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.385036:0:14262:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787032329.385038:0:14262:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdf4cdf000 00000020:00000080:3.0:1787032329.385039:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787032329.385251:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.385255:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.385256:0:14262:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787032329.385257:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032329.385259:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.385260:0:14262:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787032329.385262:0:14262:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cdf4cdf000 00000020:00000080:3.0:1787032329.385264:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787032329.394706:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14262:1873838857085440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787032329.394820:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032329.394861:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857085440 00000100:00100000:2.0:1787032329.394869:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857085440 00000100:00100000:3.0:1787032329.394871:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc3af3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.394931:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787032329.394940:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14262:x1873838857085440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032329.395336:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14262:x1873838857085440:12345-0@lo:502:llog_process_th.0 Request processed in 395us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.395344:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787032329.396380:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14262:1873838857085440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787032329.396421:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032329.396429:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032329.396431:0:14262:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787032329.396438:0:14262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787032329.396685:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787032329.396710:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787032329.396737:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.396749:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032329.396819:0:14218:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787032329.396823:0:14218:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cdf4cdf000 10000000:01000000:0.0:1787032329.396826:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cdf4cdf000 10000000:01000000:0.0:1787032329.396831:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787032329.396837:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cdf4cdf000 from 1 10000000:01000000:0.0:1787032329.396840:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787032329.396871:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1536200/0xcd047797ef1ea92c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.396880:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1536200/0xcd047797ef1ea92c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.396889:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1536200/0xcd047797ef1ea92c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032329.396907:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787032329.396955:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032329.396988:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39600 going to sleep for 11 seconds 00000100:00100000:0.0:1787032329.397008:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857085568 00000100:00100000:0.0:1787032329.397013:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857085568 00000100:00100000:0.0:1787032329.397049:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787032329.397057:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14218:x1873838857085568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787032329.397093:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032329.397107:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1536600/0xcd047797ef1ea933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea92c expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.397143:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1536600/0xcd047797ef1ea933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea92c expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.397164:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1536600/0xcd047797ef1ea933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea92c expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.397174:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536600, rc 0) 00000100:00100000:0.0:1787032329.397208:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14218:x1873838857085568:12345-0@lo:101:mount.lustre.0 Request processed in 151us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032329.397215:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787032329.397257:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787032329.397270:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1536200/0xcd047797ef1ea92c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea933 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.397279:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1536200/0xcd047797ef1ea92c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea933 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032329.397324:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032329.397348:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032329.397365:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39600 going to sleep for 11 seconds 00000100:00100000:3.0:1787032329.398380:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857085696 00000100:00100000:3.0:1787032329.398397:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857085696 00000100:00100000:3.0:1787032329.398439:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787032329.398447:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdd9547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14218:x1873838857085696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787032329.398769:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdd9547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14218:x1873838857085696:12345-0@lo:501:mount.lustre.0 Request processed in 323us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032329.398777:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787032329.399031:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032329.399152:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787032329.399203:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032329.399231:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39600 going to sleep for 11 seconds 00000100:00100000:0.0:1787032329.399247:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857085824 00000100:00100000:0.0:1787032329.399251:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857085824 00000100:00100000:0.0:1787032329.399283:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787032329.399289:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdd9546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14218:x1873838857085824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787032329.399469:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdd9546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14218:x1873838857085824:12345-0@lo:503:mount.lustre.0 Request processed in 180us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032329.399477:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787032329.400770:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857085824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032329.403044:0:14267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14267:1873838857085952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032329.403655:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032329.403699:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857085952 00000100:00100000:2.0:1787032329.403707:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857085952 00000100:00100000:2.0:1787032329.403751:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787032329.403758:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdd9544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14267:x1873838857085952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032329.405471:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdd9544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14267:x1873838857085952:12345-0@lo:502:llog_process_th.0 Request processed in 1706us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.405480:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787032329.407054:0:14267:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd94ceb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787032329.407108:0:14267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14267:1873838857085952:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787032329.407213:0:14267:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787032329.407232:0:14267:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99cdc8184d40) 00000020:00000080:3.0:1787032329.407255:0:14267:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787032329.407475:0:14267:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdf4cdf000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787032329.407481:0:14267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cdf4cdf000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787032329.407483:0:14267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdf4cdf000 4 00010000:00080000:3.0:1787032329.407887:0:14267:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cdc9d78800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.148@tcp at head 00010000:00010000:2.0:1787032329.414408:0:14267:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787032329.414523:0:14267:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787032329.414562:0:14267:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787032329.414575:0:14267:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd047797ef1ea941 00000100:00080000:2.0:1787032329.414586:0:14267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787032329.414592:0:14267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cdc9d78800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:2.0:1787032329.414630:0:14267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdfb135180 x1873838857086080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787032329.414674:0:14267:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787032329.415053:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838857086080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787032329.415162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032329.415635:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857086080 00000100:00100000:2.0:1787032329.415645:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857086080 00000100:00100000:2.0:1787032329.415682:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787032329.415689:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1873838857086080:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787032329.417293:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1873838857086080:12345-0@lo:38:llog_process_th.0 Request processed in 1595us (2124us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787032329.417305:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787032329.417455:0:14267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14267:1873838857086208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032329.417536:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032329.417580:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857086208 00000100:00100000:2.0:1787032329.417586:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857086208 00000100:00100000:2.0:1787032329.417625:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787032329.417633:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdd9545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14267:x1873838857086208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787032329.417905:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdd9545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14267:x1873838857086208:12345-0@lo:502:llog_process_th.0 Request processed in 272us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032329.417911:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787032329.417959:0:14267:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd94ce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032329.417983:0:14267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8b69d5fe-062a-4046-aadd-ee94584b57f2:14267:1873838857086208:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787032329.418012:0:14267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787032329.418359:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787032329.418392:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787032329.418410:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1536200/0xcd047797ef1ea92c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea933 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.418422:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1536200/0xcd047797ef1ea92c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea933 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787032329.418471:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787032329.418474:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787032329.418475:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032329.418476:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032329.418477:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032329.418478:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032329.418480:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787032329.418481:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787032329.418483:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032329.418484:0:14218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787032329.418489:0:14218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787032329.418491:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787032329.418492:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787032329.418493:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032329.418495:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032329.418496:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032329.418497:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032329.418509:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787032329.418510:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787032329.418511:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032329.418512:0:14218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787032329.418537:0:14218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787032329.418549:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857086336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787032329.418595:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032329.421051:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39300 going to sleep for 11 seconds 00000100:00100000:3.0:1787032329.422681:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857086336 00000100:00100000:3.0:1787032329.422696:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857086336 00000100:00100000:3.0:1787032329.422755:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787032329.422765:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14218:x1873838857086336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787032329.422867:0:14230:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787032329.422882:0:14230:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787032329.423480:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787032329.423492:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d78800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787032329.423497:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787032329.424431:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838857086080:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787032329.477993:0:14230:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787032329.478009:0:14230:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787032329.478052:0:14252:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787032329.478057:0:14252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787032329.478107:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478127:0:14252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478136:0:14252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478177:0:14252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478192:0:14252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 12 pid: 14231 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032329.478207:0:14252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1873838857086464:0@lo:104: 00000100:00100000:0.0:1787032329.478276:0:14252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032329.478317:0:14252:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd9587780 going to sleep for 11 seconds 00000100:00100000:0.0:1787032329.478378:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857086464 00000100:00100000:0.0:1787032329.478386:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857086464 00000100:00100000:0.0:1787032329.478429:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032329.478438:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:14252:x1873838857086464:12345-0@lo:104: 00010000:00010000:0.0:1787032329.478451:0:14219:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478516:0:14219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787032329.478522:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:14252:x1873838857086464:12345-0@lo:104: Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032329.478529:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032329.478589:0:14252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1873838857086464:0@lo:104: 00010000:00010000:0.0:1787032329.478608:0:14252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478626:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032329.478632:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478639:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775400 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032329.478643:0:14225:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478651:0:14225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032329.478658:0:14225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032329.478664:0:14225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787032329.478692:0:14225:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478698:0:14225:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032329.478719:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478738:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7775400/0xcd047797ef1ea910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea917 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.478753:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032329.478755:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032329.478756:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032329.478928:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857086592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032329.478958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032329.479037:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857086592 00000100:00100000:0.0:1787032329.479042:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857086592 00010000:00010000:0.0:1787032329.479059:0:14221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 13 pid: 14231 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032329.479102:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032329.479109:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+13:3305:x1873838857086592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787032329.479119:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032329.479124:0:14221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 13 pid: 14231 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479134:0:14221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 13 pid: 14231 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479147:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef418600/0xcd047797ef1ea917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1ea910 expref: 13 pid: 14231 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479160:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479178:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787032329.479191:0:14221:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001135358s 00010000:00010000:0.0:1787032329.479196:0:14221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479203:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479210:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479217:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479223:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032329.479228:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479235:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479249:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479259:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032329.479289:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:3305:x1873838857086592:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032329.479296:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787032329.479323:0:14252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479330:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032329.479336:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1537000/0xcd047797ef1ea948 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032329.479378:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857086592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032329.487803:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14218:x1873838857086336:12345-0@lo:253:mount.lustre.0 Request processed in 65029us (69197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032329.487820:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787032329.487910:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14218:1873838857086336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787032329.487925:0:14218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787032329.487927:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787032329.487929:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787032329.487929:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032329.487930:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032329.487931:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032329.487932:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032329.487933:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787032329.487934:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787032329.487935:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032329.487936:0:14218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787032329.487953:0:14218:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787032329.492434:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787032329.492614:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787032329.493167:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787032329.493328:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787032329.493618:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787032329.493781:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787032329.494952:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787032329.495201:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787032329.495485:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787032329.495712:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787032329.496048:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787032329.496300:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787032329.532233:0:14218:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787032329.533422:0:14218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787032329.533607:0:14274:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787032329.533612:0:14274:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787032329.533751:0:14275:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787032329.533859:0:14275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787032329.535905:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787032329.535984:0:14275:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787032329.535990:0:14275:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787032329.538618:0:14218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787032329.538754:0:14218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787032329.539245:0:14218:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787032329.539253:0:14218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787032329.545255:0:14218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787032329.546282:0:14218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787032329.546814:0:14218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787032329.546850:0:14218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787032329.551962:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787032329.566255:0:14218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787032329.607961:0:14218:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787032329.608000:0:14218:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6d1c1b17988 00100000:10000000:3.0:1787032329.608022:0:14218:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787032329.609031:0:14218:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787032329.609048:0:14218:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787032329.609110:0:14218:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787032329.609143:0:14218:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787032329.987885:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787032330.435897:0:14233:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787032330.435905:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cdf4cdf000 from 6 10000000:01000000:1.0:1787032330.435910:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787032330.435967:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032330.435978:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032330.435987:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032330.436012:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857086720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787032330.436224:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032330.436267:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032330.437800:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857086720 00000100:00100000:2.0:1787032330.437814:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857086720 00000100:00100000:2.0:1787032330.437886:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787032330.437896:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14233:x1873838857086720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032330.437915:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032330.437937:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea94f expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032330.437966:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032330.437993:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032330.438002:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7a00, rc 0) 00000100:00100000:2.0:1787032330.438099:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14233:x1873838857086720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032330.438105:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787032330.438293:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857086720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032330.438319:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032330.438327:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032330.438407:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857086848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787032330.438445:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032330.438597:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032330.440442:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857086848 00000100:00100000:2.0:1787032330.440451:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857086848 00000100:00100000:2.0:1787032330.440504:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787032330.440514:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14233:x1873838857086848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787032330.440540:0:14230:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787032330.440556:0:14230:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787032330.440559:0:14230:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787032330.442268:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14233:x1873838857086848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1394us (3461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032330.442280:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787032330.442922:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857086848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787032330.442979:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787032330.442990:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032330.443002:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787032330.502450:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787032331.012053:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787032331.525490:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787032332.034147:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032333.070096:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032334.083133:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787032334.596423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787032334.596430:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787032334.596433:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787032334.596436:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787032334.596439:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787032334.596442:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787032334.596446:0:8:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d78800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787032334.596460:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99cdc9d78800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:1.0:1787032334.596491:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdf4877b80 x1873838857087104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787032334.596537:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787032334.596551:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857086976:0@lo:400:kworker.0 00000100:00100000:1.0:1787032334.596616:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032334.596667:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838857087104:0@lo:38:kworker.0 00000100:00100000:1.0:1787032334.596700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032334.596778:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857087104 00000100:00100000:1.0:1787032334.596785:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857087104 00000100:00100000:1.0:1787032334.596816:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787032334.596822:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1873838857087104:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787032334.596848:0:14238:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1787032334.596884:0:14238:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd047797ef1ea95d 00000004:00100000:1.0:1787032334.596898:0:14238:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787032334.597032:0:14238:0:(import.c:65:import_set_state_nolock()) ffff99ccc1946000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787032334.597096:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873838857087104:12345-0@lo:38:kworker.0 Request processed in 272us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032334.597105:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787032334.597144:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdf4877b80 x1873838857087104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787032344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787032334.597160:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787032334.597167:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787032334.597172:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787032334.597175:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d78800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787032334.597180:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873838857087104:0@lo:38:kworker.0 00000100:00100000:0.0:1787032334.598551:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857086976 00000100:00100000:0.0:1787032334.598563:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857086976 00000100:00100000:0.0:1787032334.598628:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787032334.598637:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:3303:x1873838857086976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032334.598707:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:3303:x1873838857086976:12345-0@lo:400:kworker.0 Request processed in 72us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032334.598714:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787032334.599380:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857086976:0@lo:400:kworker.0 00010000:00010000:3.0:1787032335.110082:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787032335.908182:0:14518:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787032336.130205:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032337.153327:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032338.178616:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032339.201420:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787032339.365970:0:14668:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9243be90 20000000:00000080:2.0:1787032339.365986:0:14668:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99cdf6b0e000 uarg=0000000000000000 20000000:01000000:2.0:1787032339.366020:0:14668:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787032339.366027:0:14668:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787032339.366033:0:14668:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787032339.368696:0:14669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787032339.368916:0:14668:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787032339.376312:0:14668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787032339.376362:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032339.376390:0:14668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 11 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032339.376399:0:14668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032339.376462:0:14668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 11 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032339.376482:0:14668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 11 pid: 14230 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032339.376500:0:14668:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14668:1873838857087232:0@lo:104: 00000100:00100000:2.0:1787032339.376573:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032339.376766:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857087232 00000100:00100000:0.0:1787032339.376788:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857087232 00000100:00100000:0.0:1787032339.376844:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032339.376853:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:14668:x1873838857087232:12345-0@lo:104: 00010000:00010000:0.0:1787032339.376869:0:14220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.376941:0:14220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787032339.376948:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:14668:x1873838857087232:12345-0@lo:104: Request processed in 96us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032339.376955:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787032339.376979:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032339.376985:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.376993:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774a00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:0.0:1787032339.376997:0:14224:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377006:0:14224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787032339.377013:0:14224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787032339.377020:0:14224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787032339.377050:0:14224:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377056:0:14224:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787032339.377094:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377103:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7774a00/0xcd047797ef1ea91e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea925 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377131:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032339.377133:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032339.377134:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032339.377155:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857087360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032339.377195:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032339.377228:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857087360 00000100:00100000:0.0:1787032339.377233:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857087360 00010000:00010000:0.0:1787032339.377250:0:14221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 12 pid: 14230 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032339.377271:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032339.377277:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:3303:x1873838857087360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787032339.377289:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032339.377296:0:14221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 12 pid: 14230 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377306:0:14221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 12 pid: 14230 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377325:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377335:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377350:0:14221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377357:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377370:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377377:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377383:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032339.377387:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377394:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377402:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032339.377412:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032339.377438:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:3303:x1873838857087360:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032339.377445:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787032339.380904:0:14668:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc1254b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787032339.380956:0:14668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc6800/0xcd047797ef1ea925 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1ea91e expref: 11 pid: 14230 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032339.380977:0:14668:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14668:1873838857087232:0@lo:104: 00010000:00010000:2.0:1787032339.381005:0:14668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032339.381014:0:14668:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032339.381020:0:14668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032339.381041:0:14668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1ea964 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032339.382142:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857087360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787032339.713209:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787032329/real 1787032329] req@ffff99ccc3692680 x1873838857084416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787032339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787032339.713224:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787032339.713231:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787032339.713234:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787032339.713237:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787032339.713244:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ccc3692680 x1873838857084416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787032339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032339.713269:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787032329/real 1787032329] req@ffff99ccc3692a00 x1873838857084160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787032339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032339.713283:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99ccc3692a00 x1873838857084160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787032339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787032339.713302:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1787032339.713314:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857087488:0@lo:400:kworker.0 00000100:00080000:1.0:1787032339.713317:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787032339.713325:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857084416:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787032339.713330:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d69000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787032339.713335:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787032339.713338:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857084160:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787032339.713386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787032339.713453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787032339.713456:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787032339.713459:0:8:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d69000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787032339.713464:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1787032339.713469:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787032339.713475:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cdc9d69000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:2.0:1787032339.713494:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdfb137b80 x1873838857087616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787032339.713508:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787032339.713511:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787032339.713513:0:8:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787032339.713515:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1787032339.713517:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787032339.713520:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cdc4c90800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:2.0:1787032339.713537:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdfb134380 x1873838857087744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787032339.713555:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857087616:0@lo:8:kworker.0 00000400:00000100:2.0:1787032339.713580:0:3301:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873838857087616 offset 0 length 520: 4 00000100:00100000:2.0:1787032339.713599:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857087744:0@lo:8:kworker.0 00000100:00100000:1.0:1787032339.713708:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857087488 00000100:00100000:1.0:1787032339.713717:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857087488 00000100:00100000:1.0:1787032339.713762:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787032339.713772:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857087488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032339.713838:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857087488:12345-0@lo:400:kworker.0 Request processed in 55us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032339.713847:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000400:00000100:2.0:1787032339.715198:0:3301:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873838857087744 offset 0 length 520: 4 00010000:00080000:2.0:1787032339.715276:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdfb137100 x1873838857087488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032339.715292:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857087488:0@lo:400:kworker.0 00010000:00010000:0.0:1787032340.228467:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787032340.737838:0:14233:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787032340.737850:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdf4cdf000 from 10 10000000:01000000:3.0:1787032340.737866:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787032340.737925:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032340.737940:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032340.737952:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032340.737989:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857087872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787032340.738103:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032340.738154:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787032340.738304:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857087872 00000100:00100000:0.0:1787032340.738313:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857087872 00000100:00100000:0.0:1787032340.738360:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787032340.738369:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+11:14233:x1873838857087872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787032340.738384:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032340.738402:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea96b expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032340.738442:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032340.738452:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032340.738462:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc1536c00, rc 0) 00000100:00100000:0.0:1787032340.738505:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14233:x1873838857087872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032340.738512:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787032340.738617:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857087872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032340.738633:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032340.738642:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032340.738700:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857088000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032340.738732:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032340.738759:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787032340.738870:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857088000 00000100:00100000:0.0:1787032340.738874:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857088000 00000100:00100000:0.0:1787032340.738902:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787032340.738908:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14233:x1873838857088000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032340.739180:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14233:x1873838857088000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032340.739188:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787032340.739390:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857088000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032340.739421:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857088128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032340.739457:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032340.739485:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc8cbc780 going to sleep for 11 seconds 00000100:00100000:1.0:1787032340.739530:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857088128 00000100:00100000:1.0:1787032340.739534:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857088128 00000100:00100000:1.0:1787032340.739563:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787032340.739569:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14233:x1873838857088128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032340.739726:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14233:x1873838857088128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032340.739741:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787032340.739945:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857088128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787032340.742035:0:14730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787032340.743742:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787032340.743779:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787032340.743792:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032340.743806:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032341.249259:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787032341.761687:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787032342.276286:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032343.301484:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787032343.771845:0:14870:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787032343.771850:0:14870:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787032343.772280:0:14870:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99cdc9d79800 00000020:01000004:3.0:1787032343.772297:0:14870:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787032343.772310:0:14870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787032343.772324:0:14870:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99cdc8183380) 00000020:00000080:3.0:1787032343.772339:0:14870:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787032343.818420:0:14870:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787032343.818787:0:14870:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787032343.819600:0:14870:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787032343.819835:0:14870:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787032343.820040:0:14870:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787032343.821781:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 523: rc = 0 00100000:10000000:1.0:1787032343.822857:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 523: rc = 0 00100000:10000000:1.0:1787032343.823175:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 523: rc = 0 00100000:10000000:1.0:1787032343.824879:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 660: rc = 0 00100000:10000000:1.0:1787032343.826923:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 660: rc = 0 00100000:10000000:1.0:1787032343.827254:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 660: rc = 0 00100000:10000000:1.0:1787032343.827517:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 660: rc = 0 00100000:10000000:1.0:1787032343.828420:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 660: rc = 0 00100000:10000000:1.0:1787032343.828731:0:14870:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 660: rc = 0 00000020:00000080:1.0:1787032343.830051:0:14870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787032343.830063:0:14870:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787032343.830095:0:14870:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd047797ef1ea980 00000020:01000004:1.0:1787032343.830114:0:14870:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787032343.830136:0:14870:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787032343.830140:0:14870:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787032343.830146:0:14870:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787032343.830150:0:14870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787032343.830162:0:14870:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99cdefda0000) 00000020:00000080:1.0:1787032343.830174:0:14870:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1787032343.833703:0:14870:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787032343.833996:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787032343.834004:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787032343.843671:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787032343.843695:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787032343.845727:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787032343.845740:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787032343.850228:0:14870:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032343.850592:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787032343.850599:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787032343.851541:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787032343.851552:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787032343.872545:0:14870:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787032343.872941:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787032343.872949:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787032343.874025:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787032343.874036:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787032343.875506:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787032343.875523:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787032343.877390:0:14870:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787032343.877523:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787032343.877528:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787032343.878291:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787032343.878301:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787032343.929714:0:14870:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787032343.929941:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787032343.930023:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787032343.931429:0:14870:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787032343.931438:0:14870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787032343.932057:0:14870:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787032343.932231:0:14870:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787032343.932239:0:14870:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787032343.953561:0:14870:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787032343.953612:0:14870:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.148@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787032343.953617:0:14870:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787032343.953619:0:14870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787032343.953620:0:14870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787032343.953621:0:14870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787032343.953623:0:14870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787032343.953624:0:14870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787032343.953626:0:14870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787032343.953627:0:14870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787032343.953629:0:14870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787032343.953633:0:14870:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787032343.953635:0:14870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787032343.953637:0:14870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787032343.953638:0:14870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787032343.953639:0:14870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787032343.953646:0:14870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787032343.953647:0:14870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787032343.953648:0:14870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787032343.953649:0:14870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787032343.953650:0:14870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787032343.953678:0:14870:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787032343.953700:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787032343.953776:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032343.953850:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5422a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032343.953993:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857088256 00000100:00100000:0.0:1787032343.954001:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857088256 00000100:00100000:0.0:1787032343.954145:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787032343.954155:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14870:x1873838857088256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787032343.954189:0:14228:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787032343.954193:0:14228:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787032343.954197:0:14228:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787032343.962726:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14870:x1873838857088256:12345-0@lo:253:mount.lustre.0 Request processed in 8563us (8940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032343.962743:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787032343.962869:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088256:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787032343.962886:0:14870:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787032343.962890:0:14870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787032343.962891:0:14870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787032343.962893:0:14870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032343.962894:0:14870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032343.962895:0:14870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032343.962897:0:14870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032343.962898:0:14870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032343.962901:0:14870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032343.962902:0:14870:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787032343.962923:0:14870:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cdc9d79800 from lustre-OST0000 10000000:01000000:3.0:1787032343.962954:0:14870:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787032343.962958:0:14870:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787032343.962967:0:14870:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cdff7c3380 local copy 00010000:00010000:3.0:1787032343.962978:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032343.963271:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787032343.963310:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032343.963353:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc61160c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032343.963441:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857088384 00000100:00100000:2.0:1787032343.963447:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857088384 00000100:00100000:2.0:1787032343.963490:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787032343.963499:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14870:x1873838857088384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787032343.963656:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14870:x1873838857088384:12345-0@lo:501:mount.lustre.0 Request processed in 158us (345us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787032343.963664:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787032343.963862:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088384:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787032343.963877:0:14870:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787032343.964046:0:14870:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787032343.964053:0:14870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032343.964063:0:14870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032343.964121:0:14870:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cdc9d79800 10000000:01000000:1.0:1787032343.964125:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787032343.964129:0:14870:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99cdff7c3380 10000000:01000000:1.0:1787032343.964131:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787032343.964134:0:14870:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff99cdff7c3380 from 1 10000000:01000000:1.0:1787032343.964137:0:14870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787032343.964163:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1ea98e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032343.964171:0:14870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1ea98e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032343.964188:0:14870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1ea98e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032343.964203:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787032343.964232:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032343.964263:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc5422780 going to sleep for 11 seconds 00000100:00100000:2.0:1787032343.964391:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857088512 00000100:00100000:2.0:1787032343.964396:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857088512 00000100:00100000:2.0:1787032343.964600:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787032343.964606:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+12:14870:x1873838857088512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787032343.964617:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032343.964632:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1ea995 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea98e expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032343.964665:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1ea995 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea98e expref: 13 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032343.964676:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc6000/0xcd047797ef1ea995 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea98e expref: 13 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032343.964685:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6000, rc 0) 00000100:00100000:2.0:1787032343.964726:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+13:14870:x1873838857088512:12345-0@lo:101:mount.lustre.0 Request processed in 119us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032343.964732:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787032343.964815:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787032343.964828:0:14870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1ea98e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea995 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032343.964836:0:14870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1ea98e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea995 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032343.964857:0:14870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787032343.964917:0:14870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1ea98e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea995 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032343.964925:0:14870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774600/0xcd047797ef1ea98e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea995 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032343.964931:0:14870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787032343.964936:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787032343.964941:0:14870:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787032343.964943:0:14870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787032343.964960:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdef419000/0xcd047797ef1ea99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032343.964967:0:14870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdef419000/0xcd047797ef1ea99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032343.964974:0:14870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdef419000/0xcd047797ef1ea99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032343.964987:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787032343.965017:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032343.965040:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc6116300 going to sleep for 11 seconds 00000100:00100000:1.0:1787032343.965127:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857088640 00000100:00100000:1.0:1787032343.965132:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857088640 00000100:00100000:1.0:1787032343.965155:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787032343.965161:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+13:14870:x1873838857088640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032343.965168:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032343.965179:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774400/0xcd047797ef1ea9a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea99c expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032343.965193:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774400/0xcd047797ef1ea9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea99c expref: 14 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032343.965201:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774400/0xcd047797ef1ea9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea99c expref: 14 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032343.965207:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774400, rc 0) 00000100:00100000:1.0:1787032343.965236:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857088640:12345-0@lo:101:mount.lustre.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032343.965242:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787032343.967140:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787032343.967169:0:14870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdef419000/0xcd047797ef1ea99c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9a3 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032343.967182:0:14870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdef419000/0xcd047797ef1ea99c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea9a3 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787032343.967976:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787032343.968901:0:14870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787032343.969208:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787032343.969256:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787032343.969290:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787032343.969342:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787032343.969377:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787032343.969473:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787032343.969533:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787032343.969540:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787032343.969626:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787032343.969690:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032343.969734:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc61166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032343.969917:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857088768 00000100:00100000:1.0:1787032343.969926:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857088768 00000100:00100000:1.0:1787032343.969976:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787032343.969986:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857088768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032343.970430:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857088768:12345-0@lo:501:mount.lustre.0 Request processed in 444us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032343.970439:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787032343.978255:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787032343.978336:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787032343.980218:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032343.980342:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc61166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787032343.981374:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857088896 00000100:00100000:1.0:1787032343.981387:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857088896 00000100:00100000:1.0:1787032343.981608:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787032343.981620:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857088896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787032343.982022:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857088896:12345-0@lo:503:mount.lustre.0 Request processed in 404us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032343.982031:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787032343.982178:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857088896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787032343.983017:0:14870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787032343.983140:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787032343.983202:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032343.987186:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc61166c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032343.987305:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857089024 00000100:00100000:2.0:1787032343.987316:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857089024 00000100:00100000:2.0:1787032343.987386:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787032343.987397:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857089024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032343.987988:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857089024:12345-0@lo:502:mount.lustre.0 Request processed in 592us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032343.987997:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787032343.988161:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787032343.988743:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787032343.988812:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787032343.988861:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787032343.988919:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787032343.988958:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787032343.988992:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787032343.989042:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787032343.989119:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787032343.989154:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787032343.989197:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787032343.989233:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787032343.989292:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787032343.989350:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787032343.989570:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032343.989629:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc61166c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032343.989764:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857089152 00000100:00100000:2.0:1787032343.989773:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857089152 00000100:00100000:2.0:1787032343.989872:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787032343.989883:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857089152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032343.990128:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857089152:12345-0@lo:502:mount.lustre.0 Request processed in 248us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032343.990137:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787032343.990268:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787032343.990351:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787032343.990365:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787032343.992023:0:14884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787032343.992035:0:14884:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787032343.992049:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787032343.992051:0:14884:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787032343.992058:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787032343.992279:0:14884:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99cdf58119c0) 00000020:00000080:3.0:1787032343.992303:0:14884:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787032343.992311:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787032343.992381:0:14884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdc9d79800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787032343.992388:0:14884:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787032343.992396:0:14884:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd047797ef1ea9b1 00010000:00010000:3.0:1787032344.003424:0:14884:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787032344.003929:0:14884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787032344.005779:0:14884:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787032344.007351:0:14884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787032344.007363:0:14884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032344.007370:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032344.007373:0:14884:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787032344.007376:0:14884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787032344.007385:0:14884:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787032344.007387:0:14884:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787032344.007389:0:14884:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787032344.007390:0:14884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787032344.007393:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032344.007395:0:14884:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787032344.007397:0:14884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032344.007412:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032344.007414:0:14884:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787032344.007418:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787032344.007420:0:14884:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787032344.007423:0:14884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032344.007425:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032344.007427:0:14884:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787032344.007429:0:14884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032344.007431:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032344.007433:0:14884:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787032344.007436:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787032344.007504:0:14884:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032344.007508:0:14884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032344.007510:0:14884:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787032344.007514:0:14884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787032344.013123:0:14870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787032344.013171:0:14870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787032344.013199:0:14870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdef419000/0xcd047797ef1ea99c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9a3 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.013213:0:14870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdef419000/0xcd047797ef1ea99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9a3 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032344.013223:0:14870:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdc9d79800 from 1 10000000:01000000:1.0:1787032344.013226:0:14870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787032344.013280:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.013290:0:14870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.013301:0:14870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032344.013367:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787032344.014297:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032344.014961:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf487acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032344.017841:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857089280 00000100:00100000:3.0:1787032344.017858:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857089280 00000100:00100000:3.0:1787032344.018117:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787032344.018128:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+14:14870:x1873838857089280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787032344.018147:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032344.018167:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea9b8 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032344.018196:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 15 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032344.018207:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 15 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032344.018226:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419c00, rc 0) 00000100:00100000:3.0:1787032344.018306:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089280:12345-0@lo:101:mount.lustre.0 Request processed in 180us (4013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032344.018313:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787032344.018418:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787032344.018438:0:14870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032344.018447:0:14870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787032344.019014:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787032344.019505:0:14870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787032344.019724:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787032344.019768:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787032344.019829:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787032344.019837:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787032344.019913:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032344.019966:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032344.035287:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032344.035433:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857089408 00000100:00100000:2.0:1787032344.035445:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857089408 00000100:00100000:2.0:1787032344.035499:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787032344.035508:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787032344.035836:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089408:12345-0@lo:501:mount.lustre.0 Request processed in 327us (15868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.035844:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787032344.036055:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032344.036177:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787032344.036227:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032344.036255:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032344.036815:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857089536 00000100:00100000:2.0:1787032344.036821:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857089536 00000100:00100000:2.0:1787032344.036855:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787032344.036863:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032344.037136:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089536:12345-0@lo:503:mount.lustre.0 Request processed in 272us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.037144:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787032344.044351:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089536:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787032344.045399:0:14870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787032344.045500:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787032344.045604:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032344.045774:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032344.046216:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857089664 00000100:00100000:2.0:1787032344.046224:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857089664 00000100:00100000:2.0:1787032344.046275:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787032344.046285:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032344.046622:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089664:12345-0@lo:502:mount.lustre.0 Request processed in 337us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.046631:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787032344.048968:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787032344.050625:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787032344.050712:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787032344.050782:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787032344.050820:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787032344.050850:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787032344.050893:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787032344.051063:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787032344.051328:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787032344.051377:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787032344.051656:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032344.051743:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf487a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787032344.051785:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857089792 00000100:00100000:0.0:1787032344.051792:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857089792 00000100:00100000:0.0:1787032344.051883:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787032344.051893:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787032344.052157:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089792:12345-0@lo:502:mount.lustre.0 Request processed in 263us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032344.052165:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787032344.052280:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787032344.052385:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787032344.052397:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787032344.053648:0:14888:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787032344.053661:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032344.053663:0:14888:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787032344.053670:0:14888:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdc9d79800 00000020:00000080:1.0:1787032344.053672:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787032344.053681:0:14888:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032344.053683:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032344.053684:0:14888:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787032344.053687:0:14888:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787032344.053701:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032344.053702:0:14888:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787032344.053707:0:14888:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdc9d79800 00000020:00000080:1.0:1787032344.053709:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787032344.053783:0:14888:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032344.053787:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032344.053789:0:14888:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787032344.053791:0:14888:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787032344.053794:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032344.053795:0:14888:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787032344.053798:0:14888:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cdc9d79800 00000020:00000080:1.0:1787032344.053800:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787032344.053839:0:14888:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787032344.053842:0:14888:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032344.053844:0:14888:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787032344.053847:0:14888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787032344.075553:0:14870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787032344.075597:0:14870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787032344.075630:0:14870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.075650:0:14870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032344.075700:0:14870:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787032344.075703:0:14870:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cdc9d79800 10000000:01000000:2.0:1787032344.075706:0:14870:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cdc9d79800 10000000:01000000:2.0:1787032344.075711:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787032344.075717:0:14870:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cdc9d79800 from 1 10000000:01000000:2.0:1787032344.075720:0:14870:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787032344.075761:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6c00/0xcd047797ef1ea9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.075768:0:14870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6c00/0xcd047797ef1ea9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.075779:0:14870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6c00/0xcd047797ef1ea9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032344.075804:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787032344.075879:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032344.075940:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857089920 00000100:00100000:2.0:1787032344.075947:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857089920 00000100:00100000:2.0:1787032344.075993:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032344.076002:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857089920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787032344.076017:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032344.076031:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7600/0xcd047797ef1ea9cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea9c6 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.076114:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7600/0xcd047797ef1ea9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea9c6 expref: 16 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.076125:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7600/0xcd047797ef1ea9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea9c6 expref: 16 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.076134:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7600, rc 0) 00000100:00100000:2.0:1787032344.076168:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857089920:12345-0@lo:101:mount.lustre.0 Request processed in 167us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.076175:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787032344.076219:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787032344.076243:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857089920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787032344.076257:0:14870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6c00/0xcd047797ef1ea9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9cd expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.076266:0:14870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6c00/0xcd047797ef1ea9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea9cd expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787032344.076858:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787032344.077342:0:14870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787032344.077628:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787032344.077681:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787032344.077717:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787032344.077772:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787032344.077811:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787032344.077871:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787032344.077916:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787032344.077957:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787032344.078028:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787032344.078094:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787032344.078156:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787032344.078225:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787032344.078287:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787032344.078331:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787032344.078383:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787032344.078419:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787032344.078454:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787032344.078500:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787032344.078532:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787032344.078561:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787032344.078622:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787032344.078663:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787032344.078697:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787032344.078753:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787032344.078798:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787032344.078833:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787032344.078884:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787032344.078921:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787032344.079023:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787032344.079033:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787032344.081942:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787032344.082031:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032344.082108:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39300 going to sleep for 11 seconds 00000100:00100000:0.0:1787032344.082185:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857090048 00000100:00100000:0.0:1787032344.082194:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857090048 00000100:00100000:0.0:1787032344.082252:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787032344.082262:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032344.082582:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090048:12345-0@lo:501:mount.lustre.0 Request processed in 321us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032344.082592:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787032344.082686:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787032344.082727:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032344.082765:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032344.082792:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857090176 00000100:00100000:2.0:1787032344.082795:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857090176 00000100:00100000:2.0:1787032344.082839:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787032344.082846:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032344.083141:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090176:12345-0@lo:503:mount.lustre.0 Request processed in 293us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.083149:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787032344.083183:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032344.083196:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787032344.084239:0:14870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787032344.084326:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032344.084385:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032344.084419:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857090304 00000100:00100000:2.0:1787032344.084424:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857090304 00000100:00100000:2.0:1787032344.084455:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787032344.084464:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032344.084712:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090304:12345-0@lo:502:mount.lustre.0 Request processed in 248us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.084721:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787032344.084773:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39300 going to sleep for 11 seconds 00000100:00100000:2.0:1787032344.084793:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787032344.085113:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787032344.085170:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787032344.085208:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787032344.085255:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787032344.085292:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787032344.085348:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787032344.085393:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787032344.085435:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787032344.085495:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787032344.085533:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787032344.085570:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787032344.085626:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787032344.085689:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787032344.085733:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787032344.085792:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787032344.085840:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787032344.085883:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787032344.085952:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787032344.086012:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787032344.086054:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787032344.086450:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787032344.086489:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787032344.086519:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787032344.086823:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787032344.086864:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787032344.086893:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787032344.087014:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787032344.087053:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787032344.087256:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787032344.087304:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787032344.087336:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787032344.087365:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787032344.087395:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787032344.087441:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787032344.087477:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787032344.087541:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787032344.087580:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787032344.087614:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787032344.087660:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787032344.087692:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787032344.087738:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032344.087827:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032344.087872:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9d39300 going to sleep for 11 seconds 00000100:00100000:3.0:1787032344.090194:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857090432 00000100:00100000:3.0:1787032344.090211:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857090432 00000100:00100000:3.0:1787032344.090279:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787032344.090290:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787032344.090609:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090432:12345-0@lo:502:mount.lustre.0 Request processed in 320us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032344.090619:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787032344.090650:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787032344.090785:0:14870:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787032344.090801:0:14870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787032344.093375:0:14893:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787032344.093395:0:14893:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99cdefc1cd40) 00000020:00000080:0.0:1787032344.093422:0:14893:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787032344.093594:0:14893:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdc9d79800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787032344.093599:0:14893:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cdc9d79800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787032344.093602:0:14893:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdc9d79800 3 00010000:00080000:0.0:1787032344.093633:0:14893:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cdefc20000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.148@tcp at head 00010000:00010000:1.0:1787032344.095410:0:14893:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787032344.095681:0:14893:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787032344.095725:0:14893:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787032344.095737:0:14893:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd047797ef1ea9db 00000100:00080000:1.0:1787032344.095747:0:14893:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787032344.095752:0:14893:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cdefc20000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:1.0:1787032344.095789:0:14893:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdf4876300 x1873838857090560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787032344.095817:0:14893:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787032344.095842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787032344.095846:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787032344.095849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787032344.095852:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787032344.096830:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1873838857090560:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787032344.096917:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032344.096992:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032344.097000:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857090688:0@lo:400:kworker.0 00000100:00100000:2.0:1787032344.097027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032344.097117:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857090560 00000100:00100000:2.0:1787032344.097125:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857090560 00000100:00100000:2.0:1787032344.097154:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857090688 00000100:00100000:2.0:1787032344.097157:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857090688 00000100:00100000:2.0:1787032344.097184:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787032344.097192:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032344.097247:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857090688:12345-0@lo:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.097254:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787032344.097273:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032344.097277:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1873838857090560:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787032344.097299:0:14237:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1787032344.097332:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd047797ef1ea9e2 00000004:00100000:2.0:1787032344.097347:0:14237:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787032344.097376:0:14237:0:(import.c:65:import_set_state_nolock()) ffff99cdfacba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787032344.097415:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873838857090560:12345-0@lo:38:llog_process_th.0 Request processed in 135us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.097428:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787032344.097475:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdf4877480 x1873838857090688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032344.097490:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857090688:0@lo:400:kworker.0 00010000:00080000:2.0:1787032344.097518:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cdf4876300 x1873838857090560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787032354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032344.097527:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787032344.097534:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787032344.097542:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787032344.097547:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787032344.097550:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdefc20000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787032344.097556:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1873838857090560:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787032344.109355:0:14893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787032344.109549:0:14870:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787032344.109585:0:14870:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787032344.109608:0:14870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6c00/0xcd047797ef1ea9c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9cd expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032344.109619:0:14870:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6c00/0xcd047797ef1ea9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9cd expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787032344.109683:0:14870:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787032344.109685:0:14870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787032344.109686:0:14870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032344.109687:0:14870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032344.109688:0:14870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032344.109690:0:14870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032344.109691:0:14870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032344.109693:0:14870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032344.109694:0:14870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787032344.109698:0:14870:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787032344.109705:0:14870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787032344.109707:0:14870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787032344.109708:0:14870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032344.109708:0:14870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032344.109709:0:14870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032344.109710:0:14870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032344.109711:0:14870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032344.109712:0:14870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032344.109713:0:14870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787032344.109739:0:14870:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787032344.109760:0:14870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090816:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787032344.109841:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032344.109889:0:14870:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc6116d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032344.110772:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857090816 00000100:00100000:1.0:1787032344.110782:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857090816 00000100:00100000:1.0:1787032344.110840:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787032344.110849:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14870:x1873838857090816:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787032344.110881:0:14228:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787032344.110911:0:14228:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787032344.151489:0:14228:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787032344.151622:0:14228:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787032344.152825:0:14252:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787032344.152834:0:14252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787032344.152857:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.152876:0:14252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 16 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.152886:0:14252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.152936:0:14252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 16 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032344.152952:0:14252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 16 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032344.152990:0:14252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1873838857090944:0@lo:104: 00000100:00100000:2.0:1787032344.153111:0:14252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032344.153285:0:14252:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc9cf8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787032344.153370:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857090944 00000100:00100000:1.0:1787032344.153381:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857090944 00000100:00100000:1.0:1787032344.153497:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787032344.153510:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:14252:x1873838857090944:12345-0@lo:104: 00010000:00010000:1.0:1787032344.153529:0:14220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.153619:0:14220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787032344.153626:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:14252:x1873838857090944:12345-0@lo:104: Request processed in 120us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032344.153633:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032344.153732:0:14252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1873838857090944:0@lo:104: 00010000:00010000:2.0:1787032344.153757:0:14252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.155096:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032344.155115:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.155127:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774e00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:1.0:1787032344.155132:0:14225:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.155143:0:14225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787032344.155180:0:14225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032344.155187:0:14225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787032344.155456:0:14225:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.155464:0:14225:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787032344.155493:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.155501:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1ea94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea956 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.155518:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032344.155519:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032344.155521:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032344.155592:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b69d5fe-062a-4046-aadd-ee94584b57f2:3302:1873838857091072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032344.155673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032344.156841:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857091072 00000100:00100000:1.0:1787032344.156852:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857091072 00010000:00010000:1.0:1787032344.156883:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 17 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032344.156913:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787032344.156924:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:3302:x1873838857091072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787032344.156938:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032344.156943:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 17 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.156955:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 17 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.156983:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1ea956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1ea94f expref: 17 pid: 14228 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.156998:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157007:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787032344.157023:0:14223:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004190025s 00010000:00010000:1.0:1787032344.157028:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157036:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157042:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157049:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157055:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032344.157059:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157084:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157113:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157130:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032344.157199:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:3302:x1873838857091072:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032344.157329:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787032344.157364:0:14252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157372:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032344.157378:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7e00/0xcd047797ef1ea9e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032344.157417:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b69d5fe-062a-4046-aadd-ee94584b57f2:3302:1873838857091072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787032344.171385:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14870:x1873838857090816:12345-0@lo:253:mount.lustre.0 Request processed in 60520us (61527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032344.171406:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787032344.171534:0:14870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:14870:1873838857090816:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787032344.171564:0:14870:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787032344.171569:0:14870:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787032344.171570:0:14870:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787032344.171590:0:14870:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032344.171591:0:14870:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032344.171592:0:14870:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032344.171594:0:14870:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032344.171595:0:14870:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787032344.171598:0:14870:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032344.171599:0:14870:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787032344.171615:0:14870:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787032344.176646:0:14870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787032344.176830:0:14870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787032344.176980:0:14870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787032344.179354:0:14870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787032344.179883:0:14870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787032344.181504:0:14870:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787032344.185642:0:14870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787032344.265938:0:14870:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787032344.265949:0:14870:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787032344.265992:0:14870:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787032344.266059:0:14870:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787032344.266111:0:14870:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787032344.266145:0:14870:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787032344.322326:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032345.349638:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787032345.732976:0:14233:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787032345.732986:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cdf4cdf000 from 7 10000000:01000000:0.0:1787032345.732991:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787032345.733032:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032345.733044:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032345.733056:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032345.733119:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857091200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787032345.733213:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032345.733274:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032345.734577:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857091200 00000100:00100000:3.0:1787032345.734589:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857091200 00000100:00100000:3.0:1787032345.734646:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787032345.734656:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+15:14233:x1873838857091200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032345.734672:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032345.734689:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1ea9f0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032345.734726:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 16 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032345.734737:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 16 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032345.734746:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418e00, rc 0) 00000100:00100000:3.0:1787032345.734820:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14233:x1873838857091200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032345.734827:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787032345.735630:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857091200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787032345.735649:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032345.735660:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032345.735718:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857091328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787032345.735759:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032345.735788:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032345.735805:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857091328 00000100:00100000:0.0:1787032345.735809:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857091328 00000100:00100000:0.0:1787032345.735840:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787032345.735847:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14233:x1873838857091328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787032345.735861:0:14228:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787032345.735876:0:14228:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787032345.735879:0:14228:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787032345.735949:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14233:x1873838857091328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032345.735956:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787032345.735987:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857091328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787032345.736039:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787032345.736046:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032345.736063:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032346.370344:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032347.394730:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032348.417284:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032349.443791:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787032349.451831:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787032349.451841:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787032349.451843:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787032349.451847:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787032349.451927:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857091456:0@lo:400:kworker.0 00000100:00100000:2.0:1787032349.452047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032349.452136:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857091584:0@lo:400:kworker.0 00000100:00100000:2.0:1787032349.452164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032349.452184:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032349.452191:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857091712:0@lo:400:kworker.0 00000100:00100000:2.0:1787032349.452214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032349.452507:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857091456 00000100:00100000:2.0:1787032349.452523:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857091456 00000100:00100000:2.0:1787032349.452570:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787032349.452578:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:3303:x1873838857091456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032349.452761:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:3303:x1873838857091456:12345-0@lo:400:kworker.0 Request processed in 183us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032349.452769:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787032349.452807:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857091584 00000100:00100000:2.0:1787032349.452811:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857091584 00000100:00100000:2.0:1787032349.452836:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857091712 00000100:00100000:2.0:1787032349.452839:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857091712 00000100:00100000:2.0:1787032349.452862:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032349.452868:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857091584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032349.452901:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857091584:12345-0@lo:400:kworker.0 Request processed in 34us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032349.452908:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032349.452918:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032349.452923:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857091712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032349.452944:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857091712:12345-0@lo:400:kworker.0 Request processed in 21us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032349.452949:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032349.453203:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857091456:0@lo:400:kworker.0 00010000:00080000:2.0:1787032349.453242:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdfb136a00 x1873838857091712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032349.453253:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857091712:0@lo:400:kworker.0 00010000:00080000:2.0:1787032349.453263:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdfb134000 x1873838857091584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032349.453285:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857091584:0@lo:400:kworker.0 00000100:00080000:0.0:1787032349.453511:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787032350.465407:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787032351.315674:0:15237:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787032351.492798:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787032352.004199:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787032352.513681:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032353.540166:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032354.380191:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787032339/real 1787032339] req@ffff99cdfb137b80 x1873838857087616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787032354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032354.380230:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cdfb137b80 x1873838857087616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787032354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032354.380241:0:3301:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787032339/real 1787032339] req@ffff99cdfb134380 x1873838857087744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787032354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032354.380253:0:3301:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99cdfb134380 x1873838857087744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787032354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787032354.380276:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d69000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787032354.380312:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787032354.380316:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857087616:0@lo:8:kworker.0 00000100:00080000:0.0:1787032354.380322:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787032354.380329:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787032354.380331:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857087744:0@lo:8:kworker.0 00000100:00080000:3.0:1787032354.381587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787032354.381593:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787032354.381597:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d69000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787032354.381606:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:3.0:1787032354.381613:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787032354.381621:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99cdc9d69000 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:3.0:1787032354.381645:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc3693800 x1873838857091968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787032354.381662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787032354.381666:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787032354.381667:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787032354.381670:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:3.0:1787032354.381673:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787032354.381677:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cdc4c90800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:3.0:1787032354.381688:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc3692300 x1873838857092096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787032354.381743:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b69d5fe-062a-4046-aadd-ee94584b57f2:3302:1873838857091840:0@lo:400:kworker.0 00000100:00100000:3.0:1787032354.381827:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032354.381898:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032354.381904:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857092224:0@lo:400:kworker.0 00000100:00100000:3.0:1787032354.381953:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032354.381985:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857092352:0@lo:400:kworker.0 00000100:00100000:3.0:1787032354.382009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032354.382050:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857092224 00000100:00100000:3.0:1787032354.382057:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857092224 00000100:00100000:3.0:1787032354.382160:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857092352 00000100:00100000:3.0:1787032354.382163:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857092352 00000100:00100000:3.0:1787032354.382191:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787032354.382198:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857092224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032354.382254:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857092224:12345-0@lo:400:kworker.0 Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032354.382261:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787032354.382279:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787032354.382286:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857092352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032354.382315:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857092352:12345-0@lo:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032354.382321:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787032354.382566:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ccc3691880 x1873838857092352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032354.382580:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857092352:0@lo:400:kworker.0 00010000:00080000:3.0:1787032354.382616:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ccc3691f80 x1873838857092224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787032354.382625:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857092224:0@lo:400:kworker.0 00000100:00100000:3.0:1787032354.382645:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857091968:0@lo:8:kworker.0 00000100:00100000:3.0:1787032354.382703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032354.382735:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857092096:0@lo:8:kworker.0 00000100:00100000:3.0:1787032354.382758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032354.382813:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857091968 00000100:00100000:3.0:1787032354.382818:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857091968 00000100:00100000:3.0:1787032354.382903:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857092096 00000100:00100000:3.0:1787032354.382924:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857092096 00000100:00100000:3.0:1787032354.382940:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787032354.382945:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1873838857091968:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787032354.382973:0:14872:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1787032354.383002:0:14872:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1ea9fe 00002000:00100000:3.0:1787032354.383017:0:14872:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cdca0cd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113701 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787032354.383021:0:14872:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787032354.383024:0:14872:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787032354.383255:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857091840 00000100:00100000:0.0:1787032354.383261:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857091840 00000100:00100000:0.0:1787032354.383299:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787032354.383306:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:3302:x1873838857091840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032354.383364:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:3302:x1873838857091840:12345-0@lo:400:kworker.0 Request processed in 47us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032354.383371:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787032354.383402:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787032354.383426:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b69d5fe-062a-4046-aadd-ee94584b57f2:3302:1873838857091840:0@lo:400:kworker.0 00002000:00080000:3.0:1787032354.388450:0:14872:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787032354.388499:0:14872:0:(import.c:65:import_set_state_nolock()) ffff99cdca0ce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787032354.388679:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1873838857091968:12345-0@lo:8:kworker.0 Request processed in 5729us (5973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032354.388691:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787032354.388726:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032354.388734:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1873838857092096:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787032354.388754:0:14872:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787032354.388787:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1873838857092096:12345-0@lo:8:kworker.0 Request processed in 53us (6027us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787032354.388793:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787032354.396253:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ccc3693800 x1873838857091968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787032374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032354.396274:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787032354.396288:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787032354.396298:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787032354.398339:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787032354.398451:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc9d69000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787032354.398484:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787032354.398496:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857091968:0@lo:8:kworker.0 00000100:00080000:0.0:1787032354.398536:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787032354.398540:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787032354.398544:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857092096:0@lo:8:kworker.0 00000004:00080000:2.0:1787032354.398669:0:14259:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787032354.398692:0:14259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14259:1873838857092608:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787032354.398755:0:14259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032354.398778:0:14259:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787032354.398789:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032354.398797:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857092480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032354.398819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787032354.398956:0:14258:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787032354.399468:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857092608 00000100:00100000:0.0:1787032354.399477:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857092608 00000100:00100000:0.0:1787032354.399543:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787032354.399556:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14259:x1873838857092608:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787032354.400345:0:14258:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 509246275059ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787032354.401511:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857092480 00000100:00100000:3.0:1787032354.401522:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857092480 00000100:00100000:3.0:1787032354.401573:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787032354.401583:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857092480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787032354.401619:0:14875:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032354.401725:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1873838857092480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032354.401732:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787032354.402017:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787032354.404299:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdfb134000 x1873838857092480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032354.404327:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857092480:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1787032354.421271:0:14873:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787032354.421287:0:14873:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787032354.421294:0:14873:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1787032354.449952:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032354.449971:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.449994:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1787032354.449999:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032354.450007:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450029:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450042:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450052:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450124:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032354.450162:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.450170:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450178:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.450194:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450205:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450230:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450238:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b61a035e/0xcd047797ef1eaa05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.450263:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.450264:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.450266:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787032354.456213:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.456231:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456254:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.456274:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.456283:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456303:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456325:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456334:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456368:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787032354.456802:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.456810:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456820:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.456823:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.456827:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456837:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456844:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456851:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.456881:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787032354.457233:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787032354.457250:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457266:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.457273:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457286:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457313:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457336:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940d6662/0xcd047797ef1eaa0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787032354.457426:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.457434:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457444:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.457446:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.457450:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457460:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457469:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457475:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457484:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787032354.457752:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787032354.457759:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457767:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775400 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.457771:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457779:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457801:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457808:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd7c5cdd/0xcd047797ef1eaa13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457829:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.457833:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457840:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.457855:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457864:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457879:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457885:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001097a3e8/0xcd047797ef1eaa1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.457907:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.457910:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.457924:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787032354.457934:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.457944:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457955:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.457965:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.457971:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457982:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457991:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.457999:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.458030:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032354.458053:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.458061:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.458106:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.458110:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.458119:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.458134:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.458151:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3f3e64a/0xcd047797ef1eaa21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.458173:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.458175:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.458177:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787032354.458565:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.458573:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.458583:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.458586:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.458590:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.458600:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.458608:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.458622:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.458638:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032354.459589:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.459603:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.459618:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774a00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.459624:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.459634:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.459658:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.459668:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b84bdf4/0xcd047797ef1eaa28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.459703:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.459705:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.459707:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.459889:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787032354.467464:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.467480:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.467510:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.467515:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.467522:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.467536:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.467546:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.467552:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.467578:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032354.468184:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.468203:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468221:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.468230:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468243:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468275:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468284:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddf50ff/0xcd047797ef1eaa2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468318:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.468321:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.468324:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787032354.468633:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.468643:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.468661:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.468666:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.468672:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.468684:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.468693:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.468701:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.468733:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032354.468768:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.468778:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468788:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.468792:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468817:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468835:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468844:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048c6f31c/0xcd047797ef1eaa36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.468870:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.468873:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.468875:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787032354.469248:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.469257:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469268:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.469271:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.469275:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469284:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469304:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469310:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469330:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032354.469461:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.469545:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469557:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7774000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.469561:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469571:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469587:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469611:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad954c2f/0xcd047797ef1eaa3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469637:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.469644:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.469647:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787032354.469779:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787032354.469788:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469797:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1787032354.469801:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032354.469805:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469815:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469824:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469830:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032354.469865:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032354.469897:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.469906:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469926:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.469930:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469939:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469953:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469961:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ddecbcb/0xcd047797ef1eaa44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.469979:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.469981:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.469982:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.471956:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.471969:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.471986:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.471991:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.471998:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472015:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472038:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472045:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472098:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032354.472190:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032354.472204:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.472217:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032354.472224:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.472236:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.472259:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.472268:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000664bed0/0xcd047797ef1eaa4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032354.472297:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.472301:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.472304:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.472709:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.472718:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472729:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.472732:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.472737:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472748:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472756:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472765:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.472801:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787032354.473366:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.473373:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473383:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.473386:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.473390:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473399:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473407:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473413:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473434:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787032354.473449:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787032354.473455:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473462:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7a00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.473473:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473483:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473713:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473723:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473742:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032354.473745:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473752:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.473755:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473763:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473772:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473780:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.473800:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.473802:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.473803:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032354.475635:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.476063:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.476112:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476132:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.476137:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.476144:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476160:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476172:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476180:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476202:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787032354.476221:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032354.476227:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476247:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.476252:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476262:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476281:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476290:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaa60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.476309:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.476311:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.476313:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.481944:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.481959:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.481979:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.481984:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.481992:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482008:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482027:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482036:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482063:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787032354.482107:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032354.482114:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482123:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6a00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.482128:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482138:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482157:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482165:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaa67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482185:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.482193:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.482195:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.482637:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.482643:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482653:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.482656:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.482660:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482670:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482679:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482686:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482704:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787032354.482713:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032354.482717:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482723:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.482726:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482744:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482756:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482762:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaa6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.482777:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.482779:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.482780:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.483373:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.483381:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483391:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.483395:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.483401:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483412:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483421:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483438:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483454:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787032354.483465:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032354.483469:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483478:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7400 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.483482:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483490:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483503:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483511:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0bf7190/0xcd047797ef1eaa75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.483525:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.483527:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.483529:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.486207:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.486237:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486255:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.486259:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.486267:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486280:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486291:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486298:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486327:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787032354.486931:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.486939:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486949:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.486952:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.486957:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486968:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486984:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.486992:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.487014:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787032354.487032:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787032354.487038:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.487045:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.487050:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.487059:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.487098:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.487107:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024d11a45/0xcd047797ef1eaa7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.487130:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032354.487770:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.488134:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.488151:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.488155:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.488163:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.488179:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.488186:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c139b27f/0xcd047797ef1eaa83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.488209:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.488211:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.488213:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.490114:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.490125:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.490139:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.490144:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.490150:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.490175:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.490185:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.490193:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.490214:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787032354.491315:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.491323:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491334:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.491337:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.491341:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491359:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491368:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491384:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491398:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787032354.491409:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787032354.491415:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491422:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.491426:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491434:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491449:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491456:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012fda88f/0xcd047797ef1eaa8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491470:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032354.491473:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491487:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7a00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.491491:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491577:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491590:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.491597:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065adee2f/0xcd047797ef1eaa91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.491667:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.494527:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.494535:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.494538:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.495346:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.495358:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.495378:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.495384:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.495391:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.495405:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.495423:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.495431:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.495459:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787032354.495943:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032354.495958:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.495974:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032354.495980:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.495993:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496027:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496037:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1009e7/0xcd047797ef1eaa98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787032354.496053:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.496063:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496100:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.496104:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.496106:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.496142:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.496147:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.496151:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496162:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496171:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496178:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496215:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787032354.496563:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032354.496572:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496590:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032354.496594:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496603:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496619:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496627:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d6a592/0xcd047797ef1eaa9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496647:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.496649:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.496653:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.496740:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.496748:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496758:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.496761:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.496766:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496776:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496783:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496791:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.496815:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787032354.496945:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032354.496952:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496963:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032354.496967:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.496977:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.497003:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.497011:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff4d1b9d/0xcd047797ef1eaaa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.497035:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.497038:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.497045:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.497343:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787032354.497350:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.497360:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.497370:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.497375:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.497385:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.497395:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.497401:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.497417:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787032354.497784:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032354.497792:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.497803:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6a00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032354.497807:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.497817:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.497834:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.497842:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a2e82b/0xcd047797ef1eaaad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.497890:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787032354.497890:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787032354.497895:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.497900:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.497903:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.500790:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1787032354.500798:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032354.500810:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.500844:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.500858:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.500887:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.501030:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787032354.501517:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032354.501528:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.501541:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032354.501547:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.501558:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.501582:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.501591:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a62f5a86/0xcd047797ef1eaab4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032354.501619:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.501621:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.501623:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787032354.503357:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787032354.503870:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.503892:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1787032354.503899:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032354.503908:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.503936:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.503948:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.503955:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.503992:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787032354.505295:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787032354.505308:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.505336:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1787032354.505340:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032354.505346:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.505361:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506141:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506157:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506195:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787032354.506215:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787032354.506223:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506232:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032354.506238:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506248:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506655:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506674:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028b3b71c/0xcd047797ef1eaabb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506706:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032354.506710:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506715:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032354.506718:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506726:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506735:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506742:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad3078f1/0xcd047797ef1eaac2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032354.506752:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.506754:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032354.506762:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032354.507112:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787032354.507945:0:14873:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1787032354.508143:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14259:x1873838857092608:12345-0@lo:5:osp-pre-0-0.0 Request processed in 108584us (109380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032354.508156:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787032354.508691:0:14259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14259:1873838857092608:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787032354.508732:0:14259:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787032354.508811:0:14259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14259:1873838857092736:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787032354.508870:0:14259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032354.508951:0:14259:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787032354.509216:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857092736 00000100:00100000:3.0:1787032354.509226:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857092736 00000100:00100000:3.0:1787032354.509577:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787032354.509590:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14259:x1873838857092736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787032354.509656:0:14872:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:0.0:1787032354.519185:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787032354.548687:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14259:x1873838857092736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 39084us (39800us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787032354.548710:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032354.548793:0:14259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14259:1873838857092736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787032354.548813:0:14259:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787032354.561408:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787032354.673028:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787032354.673049:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787032355.588737:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032356.609213:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032357.634301:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787032358.265484:0:15540:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787032358.265488:0:15540:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787032358.265625:0:15540:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99cdefc56000 00000020:01000004:0.0:1787032358.265641:0:15540:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787032358.265655:0:15540:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787032358.265668:0:15540:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99cdefc1b380) 00000020:00000080:0.0:1787032358.265684:0:15540:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787032358.298991:0:15540:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787032358.300676:0:15540:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787032358.302900:0:15540:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787032358.304046:0:15540:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787032358.305417:0:15540:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787032358.305839:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 469: rc = 0 00100000:10000000:0.0:1787032358.306332:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 469: rc = 0 00100000:10000000:0.0:1787032358.306431:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 469: rc = 0 00100000:10000000:0.0:1787032358.306951:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 550: rc = 0 00100000:10000000:0.0:1787032358.307394:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 550: rc = 0 00100000:10000000:0.0:1787032358.307659:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 550: rc = 0 00100000:10000000:0.0:1787032358.307934:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 550: rc = 0 00100000:10000000:0.0:1787032358.308535:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 550: rc = 0 00100000:10000000:0.0:1787032358.308784:0:15540:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 550: rc = 0 00000020:00000080:1.0:1787032358.311255:0:15540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787032358.311269:0:15540:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787032358.311280:0:15540:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd047797ef1eaad0 00000020:01000004:1.0:1787032358.311289:0:15540:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787032358.311310:0:15540:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787032358.311314:0:15540:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787032358.311321:0:15540:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787032358.311344:0:15540:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787032358.311348:0:15540:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787032358.322012:0:15540:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787032358.322050:0:15540:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.148@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787032358.322055:0:15540:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787032358.322057:0:15540:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787032358.322275:0:15540:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787032358.322277:0:15540:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787032358.322278:0:15540:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787032358.322280:0:15540:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787032358.322281:0:15540:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787032358.322283:0:15540:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787032358.322284:0:15540:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787032358.322289:0:15540:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787032358.322291:0:15540:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787032358.322293:0:15540:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787032358.322294:0:15540:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787032358.322295:0:15540:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787032358.322296:0:15540:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787032358.322297:0:15540:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787032358.322298:0:15540:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787032358.322299:0:15540:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787032358.322300:0:15540:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787032358.322330:0:15540:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787032358.322352:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857092864:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787032358.322447:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.322559:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032358.322634:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857092864 00000100:00100000:2.0:1787032358.322642:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857092864 00000100:00100000:2.0:1787032358.322735:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787032358.322745:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:15540:x1873838857092864:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787032358.322779:0:14228:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787032358.322782:0:14228:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787032358.322786:0:14228:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787032358.345689:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:15540:x1873838857092864:12345-0@lo:253:mount.lustre.0 Request processed in 22935us (23232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032358.345706:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787032358.345925:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857092864:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787032358.345940:0:15540:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787032358.345943:0:15540:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787032358.345945:0:15540:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787032358.345947:0:15540:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787032358.345948:0:15540:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787032358.345949:0:15540:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787032358.345950:0:15540:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787032358.345952:0:15540:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787032358.345954:0:15540:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787032358.345955:0:15540:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787032358.345977:0:15540:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99cdefc56000 from lustre-OST0001 10000000:01000000:1.0:1787032358.346004:0:15540:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787032358.346007:0:15540:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787032358.346015:0:15540:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99cdff7c3380 local copy 00010000:00010000:1.0:1787032358.346026:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032358.346425:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857092992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032358.346469:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.346508:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032358.346578:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857092992 00000100:00100000:0.0:1787032358.346584:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857092992 00000100:00100000:0.0:1787032358.346638:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787032358.346647:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:15540:x1873838857092992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032358.346935:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:15540:x1873838857092992:12345-0@lo:501:mount.lustre.0 Request processed in 288us (465us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032358.346943:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787032358.347205:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857092992:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787032358.347223:0:15540:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787032358.347389:0:15540:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787032358.347397:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.347408:0:15540:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1537e00/0xcd047797ef1ea876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1ea87d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032358.347439:0:15540:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99cdefc56000 10000000:01000000:1.0:1787032358.347444:0:15540:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787032358.347448:0:15540:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787032358.347451:0:15540:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787032358.347455:0:15540:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787032358.347458:0:15540:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787032358.347486:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1eaad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.347495:0:15540:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1eaad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.347504:0:15540:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1eaad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032358.347519:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787032358.347548:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.347580:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032358.347700:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857093120 00000100:00100000:3.0:1787032358.347705:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857093120 00000100:00100000:3.0:1787032358.347741:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787032358.347748:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:15540:x1873838857093120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787032358.347758:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032358.347770:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418200/0xcd047797ef1eaade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1eaad7 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.347800:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418200/0xcd047797ef1eaade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1eaad7 expref: 17 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.347821:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418200/0xcd047797ef1eaade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1eaad7 expref: 17 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.347830:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418200, rc 0) 00000100:00100000:3.0:1787032358.347873:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093120:12345-0@lo:101:mount.lustre.0 Request processed in 126us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032358.347879:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787032358.347980:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032358.347992:0:15540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1eaad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaade expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.348001:0:15540:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1eaad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1eaade expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787032358.348643:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787032358.349779:0:15540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787032358.350613:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787032358.350671:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787032358.350704:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787032358.350752:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787032358.352372:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787032358.352483:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787032358.352580:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787032358.352589:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787032358.352690:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032358.352755:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.353010:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032358.355901:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857093248 00000100:00100000:2.0:1787032358.355916:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857093248 00000100:00100000:2.0:1787032358.356034:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787032358.356046:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787032358.356756:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093248:12345-0@lo:501:mount.lustre.0 Request processed in 710us (3997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032358.356765:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787032358.360387:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032358.361488:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787032358.361572:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032358.361607:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787032358.361686:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857093376 00000100:00100000:2.0:1787032358.361693:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857093376 00000100:00100000:2.0:1787032358.361749:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787032358.361764:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032358.362456:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093376:12345-0@lo:503:mount.lustre.0 Request processed in 690us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032358.362464:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787032358.364913:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787032358.369971:0:15540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787032358.370685:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787032358.370778:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032358.370827:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787032358.370938:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857093504 00000100:00100000:2.0:1787032358.370948:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857093504 00000100:00100000:2.0:1787032358.371007:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787032358.371016:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032358.371543:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093504:12345-0@lo:502:mount.lustre.0 Request processed in 525us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032358.371552:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787032358.372376:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787032358.372694:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787032358.372758:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787032358.372900:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787032358.372953:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787032358.372990:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787032358.373025:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787032358.373434:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787032358.373624:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787032358.373678:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787032358.373728:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032358.373917:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032358.374017:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787032358.375233:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857093632 00000100:00100000:3.0:1787032358.375246:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857093632 00000100:00100000:3.0:1787032358.375430:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787032358.375441:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787032358.375761:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093632:12345-0@lo:502:mount.lustre.0 Request processed in 322us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032358.375769:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787032358.376006:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787032358.376376:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787032358.376394:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787032358.377619:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787032358.377630:0:15542:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787032358.377637:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787032358.377640:0:15542:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787032358.377645:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787032358.377660:0:15542:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99cdefda4d40) 00000020:00000080:1.0:1787032358.377682:0:15542:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787032358.377688:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787032358.377750:0:15542:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdefc56000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787032358.377758:0:15542:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787032358.377772:0:15542:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd047797ef1eaaec 00010000:00010000:2.0:1787032358.387771:0:15542:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787032358.388545:0:15542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787032358.395576:0:15542:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787032358.399557:0:15542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787032358.399572:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032358.399580:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032358.399582:0:15542:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787032358.399588:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032358.399592:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032358.399594:0:15542:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787032358.399597:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787032358.399599:0:15542:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787032358.399601:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032358.399604:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032358.399605:0:15542:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787032358.399608:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787032358.399610:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032358.399611:0:15542:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787032358.399615:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787032358.399689:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787032358.399693:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787032358.399694:0:15542:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787032358.399698:0:15542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787032358.400198:0:15540:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787032358.400231:0:15540:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787032358.400251:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1eaad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaade expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032358.400274:0:15540:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774e00/0xcd047797ef1eaad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaade expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787032358.400294:0:15540:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdefc56000 from 1 10000000:01000000:2.0:1787032358.400297:0:15540:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787032358.400339:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032358.400347:0:15540:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032358.400358:0:15540:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032358.400384:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787032358.400450:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032358.400486:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032358.400601:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857093760 00000100:00100000:3.0:1787032358.400610:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857093760 00000100:00100000:3.0:1787032358.400660:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787032358.400670:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:15540:x1873838857093760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787032358.400684:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032358.400696:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1eaaf3 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.400720:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.400731:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.400751:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418600, rc 0) 00000100:00100000:3.0:1787032358.400811:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef89a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857093760:12345-0@lo:101:mount.lustre.0 Request processed in 142us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032358.400819:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787032358.400922:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787032358.400937:0:15540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032358.400946:0:15540:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787032358.401470:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787032358.401827:0:15540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787032358.402060:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787032358.402145:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787032358.402231:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787032358.402239:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787032358.402305:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787032358.402357:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032358.402387:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032358.402416:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857093888 00000100:00100000:2.0:1787032358.402421:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857093888 00000100:00100000:2.0:1787032358.402450:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787032358.402458:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857093888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787032358.402642:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857093888:12345-0@lo:501:mount.lustre.0 Request processed in 184us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032358.402650:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787032358.402691:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857093888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787032358.402720:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032358.402756:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032358.402770:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787032358.402782:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857094016 00000100:00100000:2.0:1787032358.402785:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857094016 00000100:00100000:2.0:1787032358.402802:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787032358.402808:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857094016:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787032358.403122:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857094016:12345-0@lo:503:mount.lustre.0 Request processed in 313us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032358.403129:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787032358.403167:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787032358.403698:0:15540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787032358.403765:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032358.403808:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032358.403833:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdd089bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787032358.403928:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857094144 00000100:00100000:3.0:1787032358.403933:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857094144 00000100:00100000:3.0:1787032358.408286:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787032358.408305:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857094144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787032358.408630:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857094144:12345-0@lo:502:mount.lustre.0 Request processed in 331us (4819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032358.408638:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787032358.408704:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787032358.409665:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787032358.409734:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787032358.409785:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787032358.409837:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787032358.409884:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787032358.409931:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787032358.409967:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787032358.409993:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787032358.410034:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3692a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787032358.410135:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032358.410176:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdff75ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032358.410308:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857094272 00000100:00100000:1.0:1787032358.410315:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857094272 00000100:00100000:1.0:1787032358.410355:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787032358.410364:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ce011d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857094272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787032358.410555:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ce011d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857094272:12345-0@lo:502:mount.lustre.0 Request processed in 192us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032358.410563:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787032358.410659:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787032358.410746:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787032358.410762:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787032358.414267:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032358.414280:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032358.414282:0:15546:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787032358.414290:0:15546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdefc56000 00000020:00000080:3.0:1787032358.414292:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787032358.414300:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032358.414303:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032358.414304:0:15546:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787032358.414306:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032358.414309:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032358.414310:0:15546:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787032358.414314:0:15546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99cdefc56000 00000020:00000080:3.0:1787032358.414316:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787032358.414408:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032358.414412:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032358.414413:0:15546:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787032358.414416:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787032358.414418:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032358.414419:0:15546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787032358.414422:0:15546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99cdefc56000 00000020:00000080:3.0:1787032358.414424:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787032358.424505:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787032358.424522:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787032358.424524:0:15546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787032358.424531:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787032358.439409:0:15540:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787032358.439458:0:15540:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787032358.439495:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.439508:0:15540:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032358.439571:0:15540:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787032358.439575:0:15540:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99cdefc56000 10000000:01000000:1.0:1787032358.439578:0:15540:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99cdefc56000 10000000:01000000:1.0:1787032358.439581:0:15540:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787032358.439587:0:15540:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff99cdefc56000 from 1 10000000:01000000:1.0:1787032358.439590:0:15540:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787032358.439631:0:15540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775000/0xcd047797ef1eab01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.439639:0:15540:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775000/0xcd047797ef1eab01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.439651:0:15540:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775000/0xcd047797ef1eab01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032358.439686:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787032358.439754:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.439817:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3165f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032358.444199:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857094400 00000100:00100000:1.0:1787032358.444217:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857094400 00000100:00100000:1.0:1787032358.444286:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787032358.444296:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857094400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032358.444315:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032358.444336:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774a00/0xcd047797ef1eab08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1eab01 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.444368:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774a00/0xcd047797ef1eab08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1eab01 expref: 19 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.444380:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774a00/0xcd047797ef1eab08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1eab01 expref: 19 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.444391:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774a00, rc 0) 00000100:00100000:1.0:1787032358.444488:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094400:12345-0@lo:101:mount.lustre.0 Request processed in 193us (4734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032358.444494:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787032358.444564:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787032358.444583:0:15540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775000/0xcd047797ef1eab01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eab08 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.444593:0:15540:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775000/0xcd047797ef1eab01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1eab08 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787032358.445298:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787032358.445803:0:15540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787032358.446156:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787032358.446203:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787032358.446237:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787032358.446282:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787032358.446319:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787032358.446380:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787032358.446431:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787032358.446467:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787032358.446524:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787032358.446560:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787032358.446615:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787032358.446666:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787032358.446704:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787032358.446737:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787032358.446800:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787032358.446836:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787032358.446885:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787032358.446935:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787032358.446970:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787032358.447003:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787032358.447047:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787032358.447106:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787032358.447159:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787032358.447206:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787032358.447243:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787032358.447276:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787032358.447322:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787032358.447357:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787032358.447390:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787032358.447452:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787032358.447487:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787032358.447521:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787032358.447552:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787032358.447601:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787032358.447637:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787032358.447679:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787032358.447714:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787032358.447795:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787032358.447802:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787032358.453055:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787032358.453155:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.453200:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3165f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787032358.456831:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857094528 00000100:00100000:0.0:1787032358.456855:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857094528 00000100:00100000:0.0:1787032358.456910:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787032358.456920:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032358.457247:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094528:12345-0@lo:501:mount.lustre.0 Request processed in 327us (4090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032358.457255:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787032358.457319:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4877100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787032358.457376:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787032358.457426:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032358.457463:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791840 going to sleep for 11 seconds 00000100:00100000:3.0:1787032358.457954:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857094656 00000100:00100000:3.0:1787032358.457962:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857094656 00000100:00100000:3.0:1787032358.458039:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787032358.458047:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787032358.458405:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094656:12345-0@lo:503:mount.lustre.0 Request processed in 358us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032358.458422:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787032358.459150:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787032358.459738:0:15540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787032358.459813:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787032358.459888:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.461469:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc31656c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032358.461509:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857094784 00000100:00100000:0.0:1787032358.461519:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857094784 00000100:00100000:0.0:1787032358.461570:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787032358.461578:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787032358.472028:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094784:12345-0@lo:502:mount.lustre.0 Request processed in 10440us (12131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032358.472045:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787032358.472245:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787032358.472554:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787032358.472611:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787032358.472648:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787032358.472696:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787032358.472734:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787032358.472781:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787032358.472816:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787032358.472866:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787032358.472915:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787032358.472952:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787032358.472998:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787032358.473048:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787032358.473114:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787032358.473163:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787032358.473226:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787032358.473267:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787032358.473299:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787032358.473347:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787032358.473384:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787032358.473418:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787032358.473464:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787032358.473501:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787032358.473535:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787032358.473594:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787032358.473630:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787032358.473664:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787032358.473711:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787032358.473748:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787032358.473780:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787032358.473863:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787032358.473899:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787032358.473926:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787032358.473955:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787032358.473997:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787032358.474028:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787032358.474091:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787032358.474128:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787032358.474978:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787032358.475054:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787032358.475290:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787032358.475338:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787032358.475420:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.475505:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc31656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032358.481353:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857094912 00000100:00100000:2.0:1787032358.481369:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857094912 00000100:00100000:2.0:1787032358.481623:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787032358.481634:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787032358.481952:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857094912:12345-0@lo:502:mount.lustre.0 Request processed in 319us (6531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032358.481960:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787032358.482056:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857094912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787032358.482190:0:15540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787032358.482205:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787032358.483274:0:15551:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787032358.483290:0:15551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99cdefda3380) 00000020:00000080:1.0:1787032358.483313:0:15551:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787032358.483482:0:15551:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99cdefc56000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787032358.483487:0:15551:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99cdefc56000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787032358.483490:0:15551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99cdefc56000 3 00010000:00080000:1.0:1787032358.483518:0:15551:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cdc9189800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.148@tcp at head 00010000:00010000:1.0:1787032358.490425:0:15551:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787032358.490547:0:15551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787032358.490589:0:15551:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787032358.490604:0:15551:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd047797ef1eab16 00000100:00080000:1.0:1787032358.490616:0:15551:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787032358.490623:0:15551:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cdc9189800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:1.0:1787032358.490665:0:15551:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdf4875880 x1873838857095040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787032358.490698:0:15551:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787032358.491127:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1873838857095040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787032358.491211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787032358.491289:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787032358.491294:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787032358.491297:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787032358.491302:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1787032358.491306:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787032358.491311:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cdc4c90800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:0.0:1787032358.491325:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cdef890a80 x1873838857095296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787032358.491387:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857095168:0@lo:400:kworker.0 00000100:00100000:0.0:1787032358.491417:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032358.491439:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787032358.491444:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857095424:0@lo:400:kworker.0 00000100:00100000:0.0:1787032358.491469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032358.491495:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857095296:0@lo:8:kworker.0 00000100:00100000:0.0:1787032358.491526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032358.491550:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857095552:0@lo:400:kworker.0 00000100:00100000:0.0:1787032358.491576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032358.491607:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857095168 00000100:00100000:0.0:1787032358.491614:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857095168 00000100:00100000:0.0:1787032358.491670:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857095296 00000100:00100000:0.0:1787032358.491674:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857095296 00000100:00100000:0.0:1787032358.491687:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032358.491696:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857095168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032358.491744:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857095168:12345-0@lo:400:kworker.0 Request processed in 49us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032358.491751:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032358.491767:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032358.491771:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1873838857095296:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787032358.492344:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1873838857095296:12345-0@lo:8:kworker.0 Request processed in 568us (814us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787032358.492351:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032358.492378:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857095040 00000100:00100000:0.0:1787032358.492382:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857095040 00000100:00100000:0.0:1787032358.492394:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857095424 00000100:00100000:0.0:1787032358.492398:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857095424 00000100:00100000:0.0:1787032358.492412:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857095552 00000100:00100000:0.0:1787032358.492415:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857095552 00000100:00100000:0.0:1787032358.492431:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787032358.492436:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857095424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032358.492467:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857095424:12345-0@lo:400:kworker.0 Request processed in 31us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032358.492474:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787032358.492496:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032358.492501:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857095552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032358.492533:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1873838857095552:12345-0@lo:400:kworker.0 Request processed in 32us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032358.492539:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032358.492551:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787032358.492554:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1873838857095040:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787032358.492569:0:14238:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:0.0:1787032358.492603:0:14238:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd047797ef1eab1d 00000004:00100000:0.0:1787032358.492623:0:14238:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787032358.492649:0:14238:0:(import.c:65:import_set_state_nolock()) ffff99cdefc20800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032358.492683:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873838857095040:12345-0@lo:38:llog_process_th.0 Request processed in 127us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032358.492690:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787032358.492712:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032358.492716:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787032358.492741:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdef893480 x1873838857095424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032358.492755:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857095424:0@lo:400:kworker.0 00000100:00100000:0.0:1787032358.492766:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787032358.492781:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857095168:0@lo:400:kworker.0 00000100:00100000:2.0:1787032358.492889:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787032358.492896:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787032358.492900:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787032358.492903:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857095296:0@lo:8:kworker.0 00010000:00080000:2.0:1787032358.492918:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdf4875880 x1873838857095040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787032368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032358.492926:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787032358.492931:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787032358.492939:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787032358.492944:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787032358.492946:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc9189800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787032358.492951:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1873838857095040:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787032358.496214:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cdef892d80 x1873838857095552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032358.496237:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1873838857095552:0@lo:400:kworker.0 00000040:00080000:1.0:1787032358.499117:0:15551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787032358.499393:0:15540:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787032358.499421:0:15540:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787032358.499442:0:15540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775000/0xcd047797ef1eab01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eab08 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.499455:0:15540:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775000/0xcd047797ef1eab01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eab08 expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787032358.499503:0:15540:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787032358.499505:0:15540:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787032358.499506:0:15540:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032358.499508:0:15540:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032358.499510:0:15540:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032358.499512:0:15540:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032358.499513:0:15540:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032358.499515:0:15540:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032358.499516:0:15540:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787032358.499520:0:15540:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787032358.499523:0:15540:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787032358.499524:0:15540:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787032358.499526:0:15540:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787032358.499526:0:15540:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787032358.499527:0:15540:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787032358.499529:0:15540:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787032358.499529:0:15540:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787032358.499530:0:15540:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787032358.499531:0:15540:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787032358.499559:0:15540:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787032358.499582:0:15540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3692a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857095680:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787032358.499665:0:15540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032358.499702:0:15540:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc31ec000 going to sleep for 11 seconds 00000100:00100000:3.0:1787032358.499731:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857095680 00000100:00100000:3.0:1787032358.499745:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857095680 00000100:00100000:3.0:1787032358.499809:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787032358.499817:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:15540:x1873838857095680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787032358.499853:0:14231:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787032358.499869:0:14231:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787032358.535226:0:14231:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787032358.535246:0:14231:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787032358.535417:0:14252:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787032358.535422:0:14252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787032358.535446:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.535465:0:14252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 19 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.535474:0:14252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.535531:0:14252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 19 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.535545:0:14252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 19 pid: 14231 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032358.535562:0:14252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1873838857095808:0@lo:104: 00000100:00100000:1.0:1787032358.535629:0:14252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032358.535680:0:14252:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc31656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787032358.535845:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857095808 00000100:00100000:2.0:1787032358.535853:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857095808 00000100:00100000:2.0:1787032358.535907:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032358.535917:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:14252:x1873838857095808:12345-0@lo:104: 00010000:00010000:2.0:1787032358.535936:0:14220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032358.535998:0:14220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787032358.536004:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:14252:x1873838857095808:12345-0@lo:104: Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032358.536012:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787032358.536126:0:14252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1873838857095808:0@lo:104: 00010000:00010000:1.0:1787032358.536148:0:14252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.544061:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032358.544094:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.544107:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537c00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:3.0:1787032358.544112:0:14224:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.544122:0:14224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032358.544130:0:14224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032358.544137:0:14224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787032358.544193:0:14224:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.544199:0:14224:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787032358.544220:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.544227:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc1537c00/0xcd047797ef1ea9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea9f7 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.544266:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032358.544268:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032358.544270:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032358.544485:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857095936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787032358.544562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032358.546943:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857095936 00000100:00100000:3.0:1787032358.546960:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857095936 00010000:00010000:3.0:1787032358.547003:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 20 pid: 14231 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032358.547034:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787032358.547042:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+20:3305:x1873838857095936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032358.547056:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032358.547062:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 20 pid: 14231 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547091:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 20 pid: 14231 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547110:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef418e00/0xcd047797ef1ea9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1ea9f0 expref: 20 pid: 14231 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547127:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547135:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787032358.547156:0:14223:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011734320s 00010000:00010000:3.0:1787032358.547161:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547189:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547195:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547202:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547208:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032358.547212:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547220:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547233:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032358.547243:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032358.547333:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3305:x1873838857095936:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032358.547342:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787032358.547979:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857095936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787032358.548290:0:14252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.548301:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032358.548307:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc7775c00/0xcd047797ef1eab24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032358.557857:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:15540:x1873838857095680:12345-0@lo:253:mount.lustre.0 Request processed in 58020us (58171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032358.557874:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787032358.557998:0:15540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8b69d5fe-062a-4046-aadd-ee94584b57f2:15540:1873838857095680:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787032358.558015:0:15540:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787032358.558019:0:15540:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787032358.558021:0:15540:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787032358.558022:0:15540:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787032358.558024:0:15540:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787032358.558026:0:15540:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787032358.558027:0:15540:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787032358.558029:0:15540:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787032358.558031:0:15540:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787032358.558032:0:15540:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787032358.558048:0:15540:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787032358.568616:0:15540:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787032358.569978:0:15540:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787032358.571502:0:15540:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787032358.571680:0:15540:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787032358.572724:0:15540:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787032358.573000:0:15540:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787032358.574023:0:15540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1787032358.663600:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787032358.748579:0:15540:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787032358.748593:0:15540:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787032358.748632:0:15540:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787032358.748697:0:15540:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787032358.748714:0:15540:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787032358.748753:0:15540:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787032359.681453:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032359.684591:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787032359.684623:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857096064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032359.684691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032359.684754:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857096064 00000100:00100000:3.0:1787032359.684762:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857096064 00000100:00100000:3.0:1787032359.684807:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032359.684825:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857096064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787032359.684860:0:14875:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032359.684906:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857096064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032359.684914:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032359.684965:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857096064:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1787032360.134475:0:14233:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787032360.134484:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff99cdf4cdf000 from 8 10000000:01000000:0.0:1787032360.134489:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787032360.134536:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1536a00/0xcd047797ef1eab2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032360.134549:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc1536a00/0xcd047797ef1eab2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032360.134559:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc1536a00/0xcd047797ef1eab2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032360.134585:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857096192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787032360.134659:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032360.134709:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787032360.135229:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857096192 00000100:00100000:2.0:1787032360.135238:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857096192 00000100:00100000:2.0:1787032360.135447:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787032360.135457:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:14233:x1873838857096192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787032360.135471:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032360.135487:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1eab32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1eab2b expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032360.135515:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1eab32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1eab2b expref: 19 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032360.135526:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7400/0xcd047797ef1eab32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1eab2b expref: 19 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032360.135534:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7400, rc 0) 00000100:00100000:2.0:1787032360.135589:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:14233:x1873838857096192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032360.135596:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787032360.136462:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857096192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787032360.136483:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc1536a00/0xcd047797ef1eab2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eab32 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032360.136493:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc1536a00/0xcd047797ef1eab2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1eab32 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032360.136553:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857096320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787032360.136597:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032360.137848:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb791b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032360.138014:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857096320 00000100:00100000:1.0:1787032360.138022:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857096320 00000100:00100000:1.0:1787032360.138063:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787032360.138097:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:14233:x1873838857096320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787032360.138119:0:14230:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787032360.138138:0:14230:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787032360.138141:0:14230:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787032360.138272:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:14233:x1873838857096320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032360.138279:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787032360.138438:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef893480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857096320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787032360.138505:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787032360.138516:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc1536a00/0xcd047797ef1eab2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eab32 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032360.138526:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc1536a00/0xcd047797ef1eab2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eab32 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032360.717451:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032361.730185:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787032362.249543:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787032362.753340:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.777250:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787032363.777505:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787032363.777510:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787032363.777513:0:37:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787032363.777525:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99cdc4c90800 using connection 192.168.201.148@tcp/0@lo 00000100:00100000:3.0:1787032363.777545:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc3690700 x1873838857096704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787032363.777607:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857096448:0@lo:400:kworker.0 00000100:00100000:0.0:1787032363.777631:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857096576:0@lo:400:kworker.0 00000100:00100000:2.0:1787032363.779797:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857096960:0@lo:400:kworker.0 00000100:00100000:0.0:1787032363.780492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032363.780559:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787032363.780568:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857096832:0@lo:400:kworker.0 00000100:00100000:3.0:1787032363.780596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032363.780599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032363.780623:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857097088:0@lo:400:kworker.0 00000100:00100000:3.0:1787032363.780653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032363.780659:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857096576 00000100:00100000:0.0:1787032363.780666:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857096576 00000100:00100000:3.0:1787032363.780681:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc3690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857096704:0@lo:8:kworker.0 00000100:00100000:3.0:1787032363.780704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032363.780716:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032363.780724:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857096576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032363.780798:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857096576:12345-0@lo:400:kworker.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032363.780806:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032363.780823:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857096704 00000100:00100000:0.0:1787032363.780826:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857096704 00000100:00100000:0.0:1787032363.780838:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787032363.780842:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1873838857096704:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787032363.780864:0:14872:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:0.0:1787032363.780892:0:14872:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd047797ef1eab39 00002000:00100000:0.0:1787032363.780904:0:14872:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99cde4b71800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113701 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787032363.780908:0:14872:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787032363.780911:0:14872:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787032363.781540:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857096448 00000100:00100000:1.0:1787032363.781545:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857096448 00000100:00100000:1.0:1787032363.781577:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787032363.781583:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3303:x1873838857096448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032363.781629:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3303:x1873838857096448:12345-0@lo:400:kworker.0 Request processed in 46us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032363.781635:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787032363.781679:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857096448:0@lo:400:kworker.0 00000100:00100000:1.0:1787032363.782456:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857096832 00000100:00100000:1.0:1787032363.782463:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857096832 00000100:00100000:1.0:1787032363.782492:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857097088 00000100:00100000:1.0:1787032363.782500:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857097088 00000100:00100000:1.0:1787032363.782524:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787032363.782537:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857096832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032363.782597:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857096832:12345-0@lo:400:kworker.0 Request processed in 60us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032363.782604:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787032363.782616:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787032363.782622:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857097088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032363.782654:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857097088:12345-0@lo:400:kworker.0 Request processed in 33us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032363.782661:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00002000:00080000:0.0:1787032363.784484:0:14872:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787032363.784519:0:14872:0:(import.c:65:import_set_state_nolock()) ffff99cde4b75000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032363.784611:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1873838857096704:12345-0@lo:8:kworker.0 Request processed in 3766us (3904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032363.784621:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787032363.784661:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032363.784666:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787032363.784711:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccc3690700 x1873838857096704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787032388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787032363.784729:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787032363.784739:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787032363.784754:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787032363.784757:0:3301:0:(import.c:65:import_set_state_nolock()) ffff99cdc4c90800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787032363.784779:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787032363.784796:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1873838857096704:0@lo:8:kworker.0 00000004:00080000:0.0:1787032363.784854:0:14261:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787032363.784874:0:14261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14261:1873838857097344:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787032363.784909:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032363.784928:0:14261:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf4a86180 going to sleep for 11 seconds 00000100:00100000:0.0:1787032363.784940:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787032363.786547:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857097216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032363.786613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032363.786669:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857097216 00000100:00100000:0.0:1787032363.786676:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857097216 00000100:00100000:0.0:1787032363.786723:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787032363.786730:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857097216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032363.786773:0:14875:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032363.786817:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1873838857097216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032363.786824:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787032363.786846:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787032363.786876:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cdef891180 x1873838857097216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787032379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032363.786896:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857097216:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787032363.786932:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccc3690000 x1873838857096832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787032363.786941:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857096832:0@lo:400:kworker.0 00000100:00100000:0.0:1787032363.787037:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857096576:0@lo:400:kworker.0 00000100:00100000:0.0:1787032363.787064:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857097344 00000100:00100000:0.0:1787032363.787099:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857097344 00000100:00100000:0.0:1787032363.787124:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787032363.787130:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14261:x1873838857097344:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787032363.788053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032363.788117:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857096960 00000100:00100000:2.0:1787032363.788122:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857096960 00000100:00100000:2.0:1787032363.788163:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787032363.788170:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857096960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032363.788222:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857096960:12345-0@lo:400:kworker.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032363.788229:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787032363.788249:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787032363.788280:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccc3691500 x1873838857097088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787032363.788293:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857097088:0@lo:400:kworker.0 00000004:00080000:3.0:1787032363.788315:0:14260:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787032363.788945:0:14260:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 518634876079ns, next at 0ns, rc = 0 00010000:00080000:2.0:1787032363.789366:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccc3693b80 x1873838857096960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787032379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787032363.789378:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99ccc3693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857096960:0@lo:400:kworker.0 00002000:00080000:0.0:1787032363.793817:0:14872:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787032363.793830:0:14872:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787032363.793837:0:14872:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787032363.814128:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.814144:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814166:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.814171:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.814189:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814206:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814216:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814223:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814242:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.814254:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.814259:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814273:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.814277:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814286:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814541:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814550:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eab40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.814570:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.814571:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.814573:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.817214:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.817227:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817245:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.817250:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.817258:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817273:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817291:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817467:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817491:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.817507:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.817513:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817520:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.817525:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817535:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817552:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817561:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eab47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.817579:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.817588:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.817590:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.818756:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.818767:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818780:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.818783:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.818789:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818799:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818807:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818814:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818828:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.818838:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.818842:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818849:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.818854:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818874:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818889:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818897:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eab4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.818913:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.818914:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.818916:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.820461:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.820471:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820485:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.820489:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.820495:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820507:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820515:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820530:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820548:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.820561:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.820565:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820573:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.820577:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820585:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820600:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820607:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eab55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.820626:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.820628:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.820630:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.821031:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.821044:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821055:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.821058:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.821063:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821101:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821109:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821117:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821132:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.821141:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.821146:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821153:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.821156:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821164:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821184:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821189:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eab5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821202:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.821203:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.821205:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.821564:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.821571:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821580:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.821584:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.821589:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821598:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821605:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821612:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821637:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.821646:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.821650:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821657:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.821661:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821668:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821679:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821685:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a11d7c4/0xcd047797ef1eab63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.821699:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.821701:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.821702:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.826123:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.826135:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826152:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.826162:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.826168:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826266:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826278:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826285:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826480:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.826496:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.826502:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826510:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.826514:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826523:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826538:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826557:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000577b9eb7/0xcd047797ef1eab6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.826576:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.826578:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.826579:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.827162:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.827171:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827256:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.827260:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.827266:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827276:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827284:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827291:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827455:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.827467:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.827478:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827486:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.827489:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827497:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827510:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827518:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eab71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.827533:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.827534:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.827536:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.830461:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.830476:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830494:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.830499:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.830505:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830531:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830543:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830551:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830576:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.830589:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.830595:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830603:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.830607:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830616:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830632:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830640:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cca5483/0xcd047797ef1eab78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.830669:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.830671:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.830673:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.834612:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.834626:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834645:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.834650:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.834656:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834672:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834682:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834689:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834712:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787032363.834723:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787032363.834729:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834759:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032363.834764:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834773:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834791:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834799:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a807f9d5/0xcd047797ef1eab7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.834819:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.834821:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.834823:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.836774:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.836786:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.836801:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.836805:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.836811:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.836822:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.836838:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.836846:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.836870:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787032363.842060:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.842095:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.842111:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.842116:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.842122:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.842135:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.842144:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.842151:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.842184:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787032363.842397:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787032363.842405:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842413:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032363.842417:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842426:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842445:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842457:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4d2d46/0xcd047797ef1eab86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842475:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032363.842479:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842485:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032363.842488:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842496:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842506:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842513:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d365ae09/0xcd047797ef1eab8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.842525:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032363.842527:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032363.842528:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.842691:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.846445:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.846459:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.846476:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.846481:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.846488:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.846504:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.846513:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.846520:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.846546:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787032363.847001:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.847008:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847017:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.847027:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.847032:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847041:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847050:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847057:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847099:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787032363.847493:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.847499:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847507:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.847510:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.847514:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847524:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847532:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847544:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847553:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787032363.847935:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.847941:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847950:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.847953:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.847957:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847967:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847975:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847982:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.847991:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787032363.848428:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.848434:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848448:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.848451:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.848455:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848465:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848473:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848480:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848489:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787032363.848855:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.848861:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848870:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.848873:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.848878:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848886:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848905:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848913:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.848921:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787032363.850284:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787032363.850296:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850308:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030400 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.850313:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850323:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850348:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850355:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004609d34e/0xcd047797ef1eab94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850378:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787032363.850382:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850388:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031400 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.850391:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850411:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850420:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850426:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a929b4/0xcd047797ef1eab9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850441:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787032363.850444:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850451:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.850454:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850462:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850471:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850489:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e77e15c8/0xcd047797ef1eaba2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850515:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787032363.850518:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850524:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.850527:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850534:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850545:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850551:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaba9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850561:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787032363.850564:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850581:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.850584:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850601:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850610:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850616:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eabb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850629:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032363.850633:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850639:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.850642:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850648:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850657:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850663:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eabb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.850686:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.850688:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.850690:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.850920:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.856531:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.856544:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.856561:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.856566:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.856572:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.856585:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.856594:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.856602:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.857015:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787032363.858786:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.858799:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.858815:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.858819:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.858825:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.858839:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.858848:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.858855:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861626:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787032363.861641:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861656:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032363.861661:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861672:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861697:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861718:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b61a035e/0xcd047797ef1eabbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861755:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787032363.861759:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861766:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1536800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032363.861770:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861777:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861788:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032363.861795:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032363.861797:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032363.861799:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032363.862609:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787032363.862619:0:14872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009620bd3a/0xcd047797ef1eabc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.862668:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.863290:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.863313:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863332:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.863336:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.863343:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863356:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863365:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863372:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863388:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787032363.863774:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.863780:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863789:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.863792:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.863796:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863805:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863825:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863831:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.863852:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787032363.863863:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787032363.863870:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863878:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537200 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.863882:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863891:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863906:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863913:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bfa0723/0xcd047797ef1eabcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863929:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032363.863933:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863950:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.863953:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863961:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863972:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863979:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abd449fb/0xcd047797ef1eabd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.863991:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.863992:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.863994:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787032363.864261:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.864267:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864276:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.864278:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.864282:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864290:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864297:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864303:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864330:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787032363.864700:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.864706:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864715:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.864718:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.864722:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864732:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864751:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864759:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.864767:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787032363.865144:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.865150:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865158:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.865166:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.865170:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865179:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865187:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865194:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865202:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787032363.865552:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.865558:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865566:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.865569:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.865574:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865583:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865591:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865603:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.865610:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787032363.867971:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787032363.867986:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868000:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc1537800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.868005:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868016:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868057:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868064:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b3e080/0xcd047797ef1eabda lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868110:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787032363.868115:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868121:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7fe00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.868124:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868131:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868142:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868149:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c482f439/0xcd047797ef1eabe1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868161:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787032363.868165:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868177:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7e800 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.868181:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868188:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868199:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868207:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012780939/0xcd047797ef1eabe8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868219:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032363.868222:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868228:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7e000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032363.868231:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868238:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868247:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868260:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d4c000/0xcd047797ef1eabef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032363.868273:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.868275:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032363.868277:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787032363.875472:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787032363.875908:0:14872:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787032363.875918:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.875936:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1787032363.875940:0:14872:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032363.876178:0:14872:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.876196:0:14872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.876207:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.876215:0:14872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032363.876272:0:14872:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787032363.876561:0:14872:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1787032363.876660:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14261:x1873838857097344:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89525us (91745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032363.876677:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787032363.876750:0:14261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14261:1873838857097344:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787032363.876766:0:14261:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787032363.876814:0:14261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14261:1873838857097472:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787032363.876846:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032363.876883:0:14261:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdf4a86180 going to sleep for 11 seconds 00000100:00100000:0.0:1787032363.876906:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857097472 00000100:00100000:0.0:1787032363.876912:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857097472 00000100:00100000:0.0:1787032363.878390:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032363.878410:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14261:x1873838857097472:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787032363.878471:0:14874:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1787032363.882494:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032363.882510:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.882536:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7fc00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032363.882542:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.882554:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.882576:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.882584:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e511530a/0xcd047797ef1eabf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032363.882604:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032363.882606:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032363.882608:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787032363.888101:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032363.896966:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14261:x1873838857097472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18555us (20110us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787032363.896980:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787032363.897038:0:14261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef891f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14261:1873838857097472:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787032363.897053:0:14261:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787032364.808146:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032364.808794:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787032364.808816:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857097600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032364.808890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032364.808984:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857097600 00000100:00100000:2.0:1787032364.808992:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857097600 00000100:00100000:2.0:1787032364.809050:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032364.809059:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857097600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032364.809147:0:14875:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032364.809262:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857097600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032364.809271:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032364.810272:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857097600:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787032365.193421:0:15898:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg148-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787032365.844267:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787032366.851371:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032367.779629:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032367.779764:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835082496 00000100:00100000:3.0:1787032367.779780:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835082496 00000100:00100000:3.0:1787032367.779850:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 74 00000100:00100000:3.0:1787032367.779863:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1873838835082496:12345-192.168.201.48@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787032367.779909:0:14231:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 12a2a834-3f08-4bf2-9411-438402fb4594@192.168.201.48@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:3.0:1787032367.779949:0:14231:0:(genops.c:1406:class_connect()) connect: client 12a2a834-3f08-4bf2-9411-438402fb4594, cookie 0xcd047797ef1eabfd 00000100:00080000:3.0:1787032367.780161:0:14231:0:(import.c:65:import_set_state_nolock()) ffff99cdca0ce000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787032367.780240:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+5:2353:x1873838835082496:12345-192.168.201.48@tcp:250:mount.lustre.0 Request processed in 378us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032367.780249:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 74 00000100:00100000:1.0:1787032367.809289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032367.809398:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835082624 00000100:00100000:2.0:1787032367.809408:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835082624 00000100:00100000:2.0:1787032367.809469:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00100000:2.0:1787032367.809480:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+5:13694:x1873838835082624:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787032367.809496:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032367.809517:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1eac04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b57 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032367.809546:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1eac04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b57 expref: 6 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032367.809556:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7a00/0xcd047797ef1eac04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b57 expref: 6 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032367.809567:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7a00, rc 0) 00000100:00100000:2.0:1787032367.809633:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+6:13694:x1873838835082624:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 154us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032367.809641:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 75 00000100:00100000:0.0:1787032367.816382:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032367.817581:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835082752 00000100:00100000:1.0:1787032367.817595:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835082752 00000100:00100000:1.0:1787032367.817660:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 76 00000100:00100000:1.0:1787032367.817681:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+6:13694:x1873838835082752:12345-192.168.201.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787032367.817980:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+6:13694:x1873838835082752:12345-192.168.201.48@tcp:501:mount.lustre.0 Request processed in 309us (1607us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787032367.817989:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 76 00000100:00100000:1.0:1787032367.829154:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032367.829238:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835082880 00000100:00100000:3.0:1787032367.829248:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835082880 00000100:00100000:3.0:1787032367.829302:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 77 00000100:00100000:3.0:1787032367.829312:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+6:13694:x1873838835082880:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787032367.829331:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032367.829350:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418000/0xcd047797ef1eac0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b5e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032367.829401:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418000/0xcd047797ef1eac0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b5e expref: 7 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032367.829413:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418000/0xcd047797ef1eac0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b5e expref: 7 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032367.829422:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418000, rc 0) 00000100:00100000:3.0:1787032367.829486:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+7:13694:x1873838835082880:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 175us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032367.829494:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 77 00000100:00100000:3.0:1787032367.831262:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032367.831369:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835083008 00000100:00100000:2.0:1787032367.831376:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835083008 00000100:00100000:2.0:1787032367.831439:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 78 00000100:00100000:2.0:1787032367.831448:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+7:13694:x1873838835083008:12345-192.168.201.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787032367.831756:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+8:13694:x1873838835083008:12345-192.168.201.48@tcp:501:mount.lustre.0 Request processed in 307us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032367.831765:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 78 00000100:00100000:0.0:1787032367.835689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032367.835783:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835083136 00000100:00100000:1.0:1787032367.835793:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835083136 00000100:00100000:1.0:1787032367.835847:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 79 00000100:00100000:1.0:1787032367.835857:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+8:13694:x1873838835083136:12345-192.168.201.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787032367.836127:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+8:13694:x1873838835083136:12345-192.168.201.48@tcp:503:mount.lustre.0 Request processed in 270us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032367.836135:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 79 00000100:00100000:1.0:1787032367.843525:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032367.843898:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835083264 00000100:00100000:3.0:1787032367.843909:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835083264 00000100:00100000:3.0:1787032367.843966:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 80 00000100:00100000:3.0:1787032367.843976:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+8:13712:x1873838835083264:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787032367.844299:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+8:13712:x1873838835083264:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 323us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032367.844307:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 80 00000100:00100000:3.0:1787032367.858040:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032367.858266:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835083392 00000100:00100000:2.0:1787032367.858278:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835083392 00000100:00100000:2.0:1787032367.858342:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 81 00000100:00100000:2.0:1787032367.858353:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+8:13712:x1873838835083392:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787032367.858773:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+8:13712:x1873838835083392:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 420us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032367.858782:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 81 00000100:00100000:0.0:1787032367.862733:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032367.863156:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835083520 00000100:00100000:1.0:1787032367.863166:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835083520 00000100:00100000:1.0:1787032367.863221:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 82 00000100:00100000:1.0:1787032367.863230:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdefd50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+8:13694:x1873838835083520:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787032367.863246:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032367.863271:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7775400/0xcd047797ef1eac12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b88 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032367.863306:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7775400/0xcd047797ef1eac12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b88 expref: 9 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032367.863316:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7775400/0xcd047797ef1eac12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b88 expref: 9 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032367.863325:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775400, rc 0) 00000100:00100000:1.0:1787032367.863379:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdefd50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+9:13694:x1873838835083520:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 150us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032367.863386:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 82 00000100:00100000:1.0:1787032367.866645:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032367.866791:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835083648 00000100:00100000:3.0:1787032367.866801:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835083648 00000100:00100000:3.0:1787032367.866854:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 83 00000100:00100000:3.0:1787032367.866864:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdd9547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+9:13694:x1873838835083648:12345-192.168.201.48@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787032367.866894:0:14231:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787032367.866921:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787032367.866929:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787032367.866933:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787032367.866935:0:14231:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787032367.870796:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdd9547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+9:13694:x1873838835083648:12345-192.168.201.48@tcp:256:mount.lustre.0 Request processed in 3921us (4148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032367.870812:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 83 00010000:00010000:2.0:1787032367.875908:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032367.876167:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032367.876262:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835083776 00000100:00100000:2.0:1787032367.876272:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835083776 00000100:00100000:2.0:1787032367.876340:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 84 00000100:00100000:2.0:1787032367.876350:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdd9546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+9:13694:x1873838835083776:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787032367.876367:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032367.876385:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2b8f expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032367.876413:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 10 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032367.876425:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 10 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032367.876452:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7800, rc 0) 00000100:00100000:2.0:1787032367.876517:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdd9546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+10:13694:x1873838835083776:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 167us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032367.876524:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 84 00000100:00100000:1.0:1787032367.882513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032367.882625:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835083904 00000100:00100000:0.0:1787032367.882637:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835083904 00000100:00100000:0.0:1787032367.882700:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 85 00000100:00100000:0.0:1787032367.882711:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdd9544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+10:13694:x1873838835083904:12345-192.168.201.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787032367.883100:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdd9544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+10:13694:x1873838835083904:12345-192.168.201.48@tcp:501:mount.lustre.0 Request processed in 358us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032367.883109:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 85 00000100:00100000:3.0:1787032367.889700:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032367.889841:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835084032 00000100:00100000:1.0:1787032367.889852:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835084032 00000100:00100000:1.0:1787032367.889907:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00100000:1.0:1787032367.889917:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdd9545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+10:13694:x1873838835084032:12345-192.168.201.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787032367.890184:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdd9545050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+10:13694:x1873838835084032:12345-192.168.201.48@tcp:503:mount.lustre.0 Request processed in 268us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032367.890192:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 86 00000100:00100000:3.0:1787032367.900576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032367.900735:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835084160 00000100:00100000:2.0:1787032367.900750:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835084160 00000100:00100000:2.0:1787032367.900828:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 87 00000100:00100000:2.0:1787032367.900838:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+10:13714:x1873838835084160:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787032367.901153:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+10:13714:x1873838835084160:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 306us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032367.901162:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 87 00000100:00100000:2.0:1787032367.910371:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032367.910587:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835084288 00000100:00100000:0.0:1787032367.910606:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835084288 00000100:00100000:0.0:1787032367.910703:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 88 00000100:00100000:0.0:1787032367.910715:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+10:13714:x1873838835084288:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787032367.912870:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+10:13714:x1873838835084288:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 2138us (2492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032367.912888:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 88 00000100:00100000:3.0:1787032367.934135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032367.934313:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835084416 00000100:00100000:1.0:1787032367.934330:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835084416 00000100:00100000:1.0:1787032367.934408:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:1.0:1787032367.934417:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1873838835084416:12345-192.168.201.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787032367.934450:0:14237:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from dca9b6b7-6411-4328-8f1f-ee2f6964ea5e@192.168.201.48@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:1.0:1787032367.934502:0:14237:0:(genops.c:1406:class_connect()) connect: client dca9b6b7-6411-4328-8f1f-ee2f6964ea5e, cookie 0xcd047797ef1eac20 00000004:00100000:1.0:1787032367.934540:0:14237:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787032367.934548:0:14237:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787032367.973473:0:14237:0:(import.c:65:import_set_state_nolock()) ffff99cdc4e14800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032367.973585:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2353:x1873838835084416:12345-192.168.201.48@tcp:38:mount.lustre.0 Request processed in 39163us (39517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032367.973596:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:3.0:1787032367.976316:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032367.976362:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032367.976437:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835084544 00000100:00100000:1.0:1787032367.976450:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835084544 00000100:00080000:0.0:1787032367.976576:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032367.976628:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835084672 00000100:00100000:1.0:1787032367.976633:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835084672 00000100:00100000:2.0:1787032367.976793:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:2.0:1787032367.976807:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:0:x1873838835084544:12345-192.168.201.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787032367.976857:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787032367.976959:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:0:x1873838835084544:12345-192.168.201.48@tcp:41:mount.lustre.0 Request processed in 155us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032367.976967:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:2.0:1787032367.977035:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:2.0:1787032367.977046:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:13694:x1873838835084672:12345-192.168.201.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787032367.977058:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787032367.978409:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:13694:x1873838835084672:12345-192.168.201.48@tcp:41:mount.lustre.0 Request processed in 1205us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032367.978440:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:0.0:1787032367.986524:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032367.987972:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835084800 00000100:00100000:3.0:1787032367.987988:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835084800 00000100:00100000:3.0:1787032367.988093:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:3.0:1787032367.988114:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:13694:x1873838835084800:12345-192.168.201.48@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787032367.988208:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:13694:x1873838835084800:12345-192.168.201.48@tcp:40:mount.lustre.0 Request processed in 105us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032367.988216:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:0.0:1787032367.990487:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032367.990528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032367.990555:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032367.990616:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835084928 00000100:00100000:3.0:1787032367.990624:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835084928 00000100:00100000:3.0:1787032367.990657:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835085056 00000100:00100000:3.0:1787032367.990659:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835085056 00000100:00100000:3.0:1787032367.990700:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:3.0:1787032367.990708:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1873838835084928:12345-192.168.201.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787032367.990736:0:14872:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from dca9b6b7-6411-4328-8f1f-ee2f6964ea5e@192.168.201.48@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:3.0:1787032367.990766:0:14872:0:(genops.c:1406:class_connect()) connect: client dca9b6b7-6411-4328-8f1f-ee2f6964ea5e, cookie 0xcd047797ef1eac27 00002000:00100000:3.0:1787032367.990779:0:14872:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca9b6b7-6411-4328-8f1f-ee2f6964ea5e/ffff99cdca0cd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787032367.990804:0:14872:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787032367.991293:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835085184 00000100:00100000:2.0:1787032367.991298:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835085184 00000100:00100000:2.0:1787032367.991342:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:2.0:1787032367.991350:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:13694:x1873838835085184:12345-192.168.201.48@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787032367.993851:0:14239:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2428us 00002000:00080000:3.0:1787032367.996448:0:14872:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787032367.996497:0:14872:0:(import.c:65:import_set_state_nolock()) ffff99cdca0ca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787032367.996635:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2353:x1873838835084928:12345-192.168.201.48@tcp:8:mount.lustre.0 Request processed in 5926us (6104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032367.996646:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:3.0:1787032367.996689:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:3.0:1787032367.996695:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1873838835085056:12345-192.168.201.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787032367.996720:0:14872:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from dca9b6b7-6411-4328-8f1f-ee2f6964ea5e@192.168.201.48@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:3.0:1787032367.996746:0:14872:0:(genops.c:1406:class_connect()) connect: client dca9b6b7-6411-4328-8f1f-ee2f6964ea5e, cookie 0xcd047797ef1eac2e 00002000:00100000:3.0:1787032367.996759:0:14872:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dca9b6b7-6411-4328-8f1f-ee2f6964ea5e/ffff99cdca0c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787032367.996785:0:14872:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787032367.996960:0:14872:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787032367.996977:0:14872:0:(import.c:65:import_set_state_nolock()) ffff99cdca0cf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787032367.997005:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2353:x1873838835085056:12345-192.168.201.48@tcp:8:mount.lustre.0 Request processed in 309us (6449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032367.997025:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00000004:00200000:2.0:1787032368.009808:0:14239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787032368.009997:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:13694:x1873838835085184:12345-192.168.201.48@tcp:33:mount.lustre.0 Request processed in 18639us (19510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032368.010008:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:0.0:1787032368.192845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032368.192952:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835085312 00000100:00100000:2.0:1787032368.192963:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835085312 00000100:00100000:2.0:1787032368.193028:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:2.0:1787032368.193040:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:13735:x1873838835085312:12345-192.168.201.48@tcp:101:mkdir.0 00010000:00010000:2.0:1787032368.193063:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032368.193149:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eac35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2bb9 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032368.193222:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eac3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032368.193237:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eac3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032368.193264:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eac3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032368.193496:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787032368.193502:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032368.193606:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eac3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032368.193638:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eac35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bb9 expref: 8 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032368.193658:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eac3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bb9 expref: 7 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032368.193684:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864600) 00010000:00010000:2.0:1787032368.193687:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032368.193690:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032368.193760:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:13735:x1873838835085312:12345-192.168.201.48@tcp:101:mkdir.0 Request processed in 722us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032368.193768:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:0.0:1787032368.897732:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857097728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787032368.897779:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032368.897826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032368.897898:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857097728 00000100:00100000:3.0:1787032368.897907:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857097728 00000100:00080000:0.0:1787032368.897954:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032368.897964:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032368.897969:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787032368.897973:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857097728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787032368.897977:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787032368.897995:0:14875:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032368.898049:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873838857097728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032368.898056:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787032368.898583:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857097728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032368.899769:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857097984:0@lo:400:kworker.0 00000100:00100000:2.0:1787032368.899775:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857098112:0@lo:400:kworker.0 00000100:00100000:1.0:1787032368.899852:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857097856:0@lo:400:kworker.0 00000100:00100000:2.0:1787032368.899921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032368.900000:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857098240:0@lo:400:kworker.0 00000100:00100000:2.0:1787032368.900027:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032368.900057:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857098112 00000100:00100000:2.0:1787032368.900063:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857098112 00000100:00100000:2.0:1787032368.900682:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857098240 00000100:00100000:2.0:1787032368.900688:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857098240 00000100:00100000:2.0:1787032368.900714:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787032368.900722:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857098112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032368.900796:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873838857098112:12345-0@lo:400:kworker.0 Request processed in 74us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032368.900804:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787032368.900822:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787032368.900829:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857098240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032368.900860:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857098240:12345-0@lo:400:kworker.0 Request processed in 32us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032368.900867:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787032368.900906:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873838857098112:0@lo:400:kworker.0 00000100:00100000:2.0:1787032368.900941:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857098240:0@lo:400:kworker.0 00000100:00080000:0.0:1787032368.902506:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032368.908336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032368.908986:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857097984 00000100:00100000:3.0:1787032368.909005:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857097984 00000100:00100000:3.0:1787032368.909099:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787032368.909568:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857097984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032368.909669:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857097984:12345-0@lo:400:kworker.0 Request processed in 561us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032368.909678:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787032368.909736:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857097984:0@lo:400:kworker.0 00000100:00080000:3.0:1787032368.909778:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787032368.910644:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032368.910693:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdfb137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857098368:0@lo:400:kworker.0 00000100:00100000:1.0:1787032368.910730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032368.910767:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857098368 00000100:00100000:1.0:1787032368.910773:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857098368 00000100:00100000:1.0:1787032368.910818:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787032368.910825:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857098368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032368.910860:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857098368:12345-0@lo:400:kworker.0 Request processed in 36us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032368.910867:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787032368.910882:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032368.910895:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857097856 00000100:00100000:1.0:1787032368.910898:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857097856 00000100:00100000:1.0:1787032368.910923:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787032368.910929:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3303:x1873838857097856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032368.910958:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3303:x1873838857097856:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032368.910965:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787032368.911005:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857098368:0@lo:400:kworker.0 00000100:00100000:1.0:1787032368.911025:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdfb136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857097856:0@lo:400:kworker.0 00000001:00080000:1.0:1787032369.072720:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787032369.072767:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787032369.072775:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca9b6b7-6411-4328-8f1f-ee2f6964ea5e 00000100:00100000:3.0:1787032369.921747:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857098496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032369.921822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032369.921904:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857098496 00000100:00100000:3.0:1787032369.921911:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857098496 00000100:00100000:3.0:1787032369.921967:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787032369.921977:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857098496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787032369.922021:0:14875:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032369.922097:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857098496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032369.922105:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787032369.922157:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857098496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787032369.922284:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787032369.971061:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca9b6b7-6411-4328-8f1f-ee2f6964ea5e 00000100:00100000:2.0:1787032370.422371:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032370.422579:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835085440 00000100:00100000:0.0:1787032370.422590:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835085440 00000100:00100000:0.0:1787032370.422681:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:0.0:1787032370.422693:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:13788:x1873838835085440:12345-192.168.201.48@tcp:41:lfs.0 00000004:00000024:0.0:1787032370.422741:0:14236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787032370.422832:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:13788:x1873838835085440:12345-192.168.201.48@tcp:41:lfs.0 Request processed in 140us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032370.422840:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00080000:1.0:1787032370.423366:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787032370.438396:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032370.439474:0:16013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835085568 00000100:00100000:2.0:1787032370.439489:0:16013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835085568 00000100:00100000:2.0:1787032370.439578:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:2.0:1787032370.439589:0:16013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:13788:x1873838835085568:12345-192.168.201.48@tcp:13:lfs.0 00002000:00000024:2.0:1787032370.439633:0:16013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032370.439731:0:16013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:13788:x1873838835085568:12345-192.168.201.48@tcp:13:lfs.0 Request processed in 143us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032370.439738:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00080000:1.0:1787032370.440756:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032370.442898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.443468:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835085696 00000100:00100000:1.0:1787032370.443478:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835085696 00000100:00100000:1.0:1787032370.443549:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:1.0:1787032370.443559:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:13788:x1873838835085696:12345-192.168.201.48@tcp:13:lfs.0 00002000:00000024:1.0:1787032370.443612:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787032370.443709:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:13788:x1873838835085696:12345-192.168.201.48@tcp:13:lfs.0 Request processed in 151us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.443718:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00080000:3.0:1787032370.445420:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032370.668508:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032370.668649:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835085824 00000100:00100000:0.0:1787032370.668659:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835085824 00000100:00100000:0.0:1787032370.668719:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 90 00000100:00100000:0.0:1787032370.668730:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+10:13820:x1873838835085824:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787032370.668747:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032370.668765:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc1a7e200/0xcd047797ef1eac43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2bc0 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032370.668797:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc1a7e200/0xcd047797ef1eac43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bc0 expref: 11 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032370.668809:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc1a7e200/0xcd047797ef1eac43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bc0 expref: 11 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032370.668835:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7e200, rc 0) 00000100:00100000:0.0:1787032370.668892:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+11:13820:x1873838835085824:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 164us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032370.668900:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 90 00000100:00100000:0.0:1787032370.674885:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.674996:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835085952 00000100:00100000:1.0:1787032370.675008:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835085952 00000100:00100000:1.0:1787032370.675110:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 91 00000100:00100000:1.0:1787032370.675120:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+11:13820:x1873838835085952:12345-192.168.201.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787032370.675773:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+11:13820:x1873838835085952:12345-192.168.201.48@tcp:501:mount.lustre.0 Request processed in 651us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.675785:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 91 00000100:00100000:3.0:1787032370.694600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.695161:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835086080 00000100:00100000:1.0:1787032370.695170:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835086080 00000100:00100000:1.0:1787032370.695232:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 92 00000100:00100000:1.0:1787032370.695242:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+11:13820:x1873838835086080:12345-192.168.201.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787032370.695483:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+11:13820:x1873838835086080:12345-192.168.201.48@tcp:503:mount.lustre.0 Request processed in 241us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.695492:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 92 00000100:00100000:2.0:1787032370.706709:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.707063:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835086208 00000100:00100000:1.0:1787032370.707103:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835086208 00000100:00100000:1.0:1787032370.707168:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 93 00000100:00100000:1.0:1787032370.707179:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+11:13827:x1873838835086208:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787032370.707666:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+11:13827:x1873838835086208:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 488us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.707675:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 93 00000100:00100000:2.0:1787032370.733962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032370.734191:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835086336 00000100:00100000:0.0:1787032370.734264:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835086336 00000100:00100000:0.0:1787032370.734328:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 94 00000100:00100000:0.0:1787032370.734340:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+11:13827:x1873838835086336:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787032370.734672:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+11:13827:x1873838835086336:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 333us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032370.734681:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 94 00000100:00100000:3.0:1787032370.745013:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.745377:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835086464 00000100:00100000:1.0:1787032370.745387:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835086464 00000100:00100000:1.0:1787032370.745449:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 95 00000100:00100000:1.0:1787032370.745458:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+11:13820:x1873838835086464:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787032370.745475:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032370.745494:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7775600/0xcd047797ef1eac4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2bea expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032370.745521:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7775600/0xcd047797ef1eac4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bea expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032370.745533:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7775600/0xcd047797ef1eac4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bea expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032370.745543:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775600, rc 0) 00000100:00100000:1.0:1787032370.745600:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+12:13820:x1873838835086464:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 142us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.745608:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 95 00000100:00100000:1.0:1787032370.750872:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032370.751370:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835086592 00000100:00100000:2.0:1787032370.751381:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835086592 00000100:00100000:2.0:1787032370.751449:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 96 00000100:00100000:2.0:1787032370.751459:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+12:13820:x1873838835086592:12345-192.168.201.48@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787032370.751486:0:14230:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787032370.751504:0:14230:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787032370.751508:0:14230:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787032370.751512:0:14230:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787032370.751514:0:14230:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787032370.757486:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+12:13820:x1873838835086592:12345-192.168.201.48@tcp:256:mount.lustre.0 Request processed in 6016us (6613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.757501:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 96 00000100:00100000:2.0:1787032370.761848:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032370.762316:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835086720 00000100:00100000:0.0:1787032370.762330:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835086720 00000100:00100000:0.0:1787032370.762468:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 97 00000100:00100000:0.0:1787032370.762480:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+12:13820:x1873838835086720:12345-192.168.201.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787032370.762503:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032370.762530:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2bf1 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032370.762565:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 13 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032370.762578:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 13 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032370.762611:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7ec00, rc 0) 00000100:00100000:0.0:1787032370.762707:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+13:13820:x1873838835086720:12345-192.168.201.48@tcp:101:mount.lustre.0 Request processed in 229us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032370.762715:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 97 00000100:00100000:2.0:1787032370.765425:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.765630:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835086848 00000100:00100000:1.0:1787032370.765640:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835086848 00000100:00100000:1.0:1787032370.765698:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 98 00000100:00100000:1.0:1787032370.765709:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfacab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:13820:x1873838835086848:12345-192.168.201.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787032370.766022:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfacab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:13820:x1873838835086848:12345-192.168.201.48@tcp:501:mount.lustre.0 Request processed in 312us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.766039:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 98 00000100:00100000:2.0:1787032370.768682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.768774:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835086976 00000100:00100000:1.0:1787032370.768784:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835086976 00000100:00100000:1.0:1787032370.768881:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 99 00000100:00100000:1.0:1787032370.768891:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:13820:x1873838835086976:12345-192.168.201.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787032370.769188:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:13820:x1873838835086976:12345-192.168.201.48@tcp:503:mount.lustre.0 Request processed in 297us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.769196:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 99 00000100:00100000:3.0:1787032370.772184:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032370.773006:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835087104 00000100:00100000:2.0:1787032370.773128:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835087104 00000100:00100000:2.0:1787032370.773289:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 100 00000100:00100000:2.0:1787032370.773302:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfaca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+13:13831:x1873838835087104:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787032370.773585:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfaca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+13:13831:x1873838835087104:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 285us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032370.773593:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 100 00000100:00100000:3.0:1787032370.775879:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.775991:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835087232 00000100:00100000:1.0:1787032370.776003:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835087232 00000100:00100000:1.0:1787032370.776092:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 101 00000100:00100000:1.0:1787032370.776104:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:13831:x1873838835087232:12345-192.168.201.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787032370.776757:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:13831:x1873838835087232:12345-192.168.201.48@tcp:502:llog_process_th.0 Request processed in 652us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.776767:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 101 00000100:00100000:3.0:1787032370.792634:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.792778:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835087360 00000100:00100000:1.0:1787032370.792789:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835087360 00000100:00100000:1.0:1787032370.792843:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:1.0:1787032370.792852:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1873838835087360:12345-192.168.201.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787032370.792885:0:14237:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 1efce990-7f6d-4d80-b404-6b6f14248bce@192.168.201.48@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:1.0:1787032370.792928:0:14237:0:(genops.c:1406:class_connect()) connect: client 1efce990-7f6d-4d80-b404-6b6f14248bce, cookie 0xcd047797ef1eac58 00000004:00100000:1.0:1787032370.792965:0:14237:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787032370.793154:0:14237:0:(import.c:65:import_set_state_nolock()) ffff99ce011f0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787032370.793236:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2353:x1873838835087360:12345-192.168.201.48@tcp:38:mount.lustre.0 Request processed in 383us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.793250:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:3.0:1787032370.797490:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032370.797585:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835087488 00000100:00100000:1.0:1787032370.797595:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835087488 00000100:00100000:1.0:1787032370.797687:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:1.0:1787032370.797697:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+6:0:x1873838835087488:12345-192.168.201.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787032370.797731:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787032370.797799:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+6:0:x1873838835087488:12345-192.168.201.48@tcp:41:mount.lustre.0 Request processed in 103us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.797806:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00080000:3.0:1787032370.797870:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787032370.800903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032370.801005:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835087616 00000100:00100000:0.0:1787032370.801015:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835087616 00000100:00100000:0.0:1787032370.801114:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:0.0:1787032370.801124:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+6:13820:x1873838835087616:12345-192.168.201.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787032370.801158:0:14236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787032370.801350:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+6:13820:x1873838835087616:12345-192.168.201.48@tcp:41:mount.lustre.0 Request processed in 227us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032370.801359:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:3.0:1787032370.803187:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032370.803545:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835087744 00000100:00100000:0.0:1787032370.803554:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835087744 00000100:00100000:0.0:1787032370.803605:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:0.0:1787032370.803676:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:13820:x1873838835087744:12345-192.168.201.48@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787032370.803760:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:13820:x1873838835087744:12345-192.168.201.48@tcp:40:mount.lustre.0 Request processed in 146us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032370.803767:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:3.0:1787032370.811870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032370.811916:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032370.811954:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032370.812062:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835087872 00000100:00100000:2.0:1787032370.812109:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835087872 00000100:00100000:2.0:1787032370.812145:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835088000 00000100:00100000:2.0:1787032370.812149:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835088000 00000100:00100000:2.0:1787032370.812165:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:2.0:1787032370.812172:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1873838835087872:12345-192.168.201.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787032370.813339:0:14873:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1efce990-7f6d-4d80-b404-6b6f14248bce@192.168.201.48@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:2.0:1787032370.813376:0:14873:0:(genops.c:1406:class_connect()) connect: client 1efce990-7f6d-4d80-b404-6b6f14248bce, cookie 0xcd047797ef1eac5f 00002000:00100000:2.0:1787032370.813390:0:14873:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1efce990-7f6d-4d80-b404-6b6f14248bce/ffff99cdefc54800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787032370.813419:0:14873:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787032370.813681:0:14873:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787032370.813713:0:14873:0:(import.c:65:import_set_state_nolock()) ffff99cdefc52000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787032370.813781:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2353:x1873838835087872:12345-192.168.201.48@tcp:8:mount.lustre.0 Request processed in 1608us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032370.813791:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:2.0:1787032370.813820:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:2.0:1787032370.813826:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1873838835088000:12345-192.168.201.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787032370.813843:0:14873:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1efce990-7f6d-4d80-b404-6b6f14248bce@192.168.201.48@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:2.0:1787032370.813860:0:14873:0:(genops.c:1406:class_connect()) connect: client 1efce990-7f6d-4d80-b404-6b6f14248bce, cookie 0xcd047797ef1eac66 00002000:00100000:2.0:1787032370.813865:0:14873:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1efce990-7f6d-4d80-b404-6b6f14248bce/ffff99cdefc53000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113701 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787032370.813872:0:14873:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787032370.814013:0:14873:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787032370.814032:0:14873:0:(import.c:65:import_set_state_nolock()) ffff99cdc7787000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787032370.814882:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835088128 00000100:00100000:0.0:1787032370.814893:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835088128 00000100:00100000:0.0:1787032370.814954:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:0.0:1787032370.814962:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:13820:x1873838835088128:12345-192.168.201.48@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787032370.815747:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2353:x1873838835088000:12345-192.168.201.48@tcp:8:mount.lustre.0 Request processed in 1914us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032370.815758:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00000004:00200000:1.0:1787032370.820146:0:14240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787032370.820479:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:13820:x1873838835088128:12345-192.168.201.48@tcp:33:mount.lustre.0 Request processed in 5511us (8612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032370.820496:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 1 00010000:00010000:1.0:1787032370.945514:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032371.016988:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032371.017141:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835088256 00000100:00100000:1.0:1787032371.017152:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835088256 00000100:00100000:1.0:1787032371.017225:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:1.0:1787032371.017236:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+6:13852:x1873838835088256:12345-192.168.201.48@tcp:101:mkdir.0 00010000:00010000:1.0:1787032371.017260:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032371.017285:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1eac6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c1b expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032371.017353:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032371.017368:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032371.017394:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032371.017604:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787032371.017618:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032371.017705:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032371.017735:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7774200/0xcd047797ef1eac6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 8 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032371.017752:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 7 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032371.017761:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864600) 00010000:00010000:1.0:1787032371.017764:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787032371.017768:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7775c00, rc 0) 00000100:00100000:1.0:1787032371.017835:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+7:13852:x1873838835088256:12345-192.168.201.48@tcp:101:mkdir.0 Request processed in 600us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032371.017842:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 14 00010000:00010000:3.0:1787032371.971717:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787032372.481735:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787032372.995326:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787032373.060719:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1efce990-7f6d-4d80-b404-6b6f14248bce 00000001:00100000:3.0:1787032373.062930:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dca9b6b7-6411-4328-8f1f-ee2f6964ea5e 00000100:00100000:2.0:1787032374.017287:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857098624:0@lo:400:kworker.0 00000100:00100000:3.0:1787032374.017307:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857098880:0@lo:400:kworker.0 00000100:00100000:1.0:1787032374.017359:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857099008:0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.019796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032374.019890:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857099136:0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.019929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032374.019970:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857098752:0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.020000:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032374.020033:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857099264:0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.020064:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032374.020100:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787032374.020106:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857099392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032374.020131:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032374.020752:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857099136 00000100:00100000:2.0:1787032374.020762:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857099136 00000100:00100000:2.0:1787032374.020820:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857099264 00000100:00100000:2.0:1787032374.020823:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857099264 00000100:00100000:2.0:1787032374.020839:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787032374.020847:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857099136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.020912:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857099136:12345-0@lo:400:kworker.0 Request processed in 66us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032374.020919:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787032374.020932:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787032374.020937:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857099264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.020963:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873838857099264:12345-0@lo:400:kworker.0 Request processed in 26us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032374.020969:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787032374.020985:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857098752 00000100:00100000:2.0:1787032374.020988:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857098752 00000100:00100000:2.0:1787032374.021013:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032374.021019:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857098752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.021046:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857098752:12345-0@lo:400:kworker.0 Request processed in 27us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032374.021051:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787032374.021091:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857099392 00000100:00100000:2.0:1787032374.021094:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857099392 00000100:00100000:2.0:1787032374.021127:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787032374.021131:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857099392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787032374.021169:0:14875:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032374.021201:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857099392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032374.021207:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787032374.021449:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787032374.021452:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032374.021455:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032374.021487:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787032374.021514:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857099392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787032374.021528:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857098752:0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.021538:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1873838857099264:0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.026159:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857099136:0@lo:400:kworker.0 00000100:00100000:0.0:1787032374.031266:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857098624 00000100:00100000:0.0:1787032374.031303:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857098624 00000100:00100000:0.0:1787032374.031381:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787032374.031391:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3305:x1873838857098624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032374.031500:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef005450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3305:x1873838857098624:12345-0@lo:400:kworker.0 Request processed in 111us (11711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032374.031508:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787032374.031972:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857098624:0@lo:400:kworker.0 00000100:00100000:1.0:1787032374.033852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032374.033895:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857099008 00000100:00100000:1.0:1787032374.033902:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857099008 00000100:00100000:1.0:1787032374.033947:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032374.033956:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857099008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032374.034021:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857099008:12345-0@lo:400:kworker.0 Request processed in 67us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032374.034029:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787032374.034095:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857099008:0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.040918:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032374.040976:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857098880 00000100:00100000:2.0:1787032374.040985:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857098880 00000100:00100000:2.0:1787032374.041057:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787032374.041083:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857098880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032374.041140:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857098880:12345-0@lo:400:kworker.0 Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032374.041286:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787032374.041341:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857098880:0@lo:400:kworker.0 00010000:00010000:3.0:1787032374.050135:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787032374.092509:0:7500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1efce990-7f6d-4d80-b404-6b6f14248bce 00000001:02000400:0.0:1787032374.132238:0:16102:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787032375.042381:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857099520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787032375.042466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032375.042557:0:16013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857099520 00000100:00100000:2.0:1787032375.042565:0:16013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857099520 00000100:00100000:2.0:1787032375.042611:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787032375.042620:0:16013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857099520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787032375.042660:0:16013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787032375.042703:0:16013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857099520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032375.042710:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787032375.042754:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857099520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787032375.042844:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787032375.079408:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1efce990-7f6d-4d80-b404-6b6f14248bce 00000100:00100000:0.0:1787032375.943915:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032375.943969:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032375.943997:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032375.944019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032375.944037:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032375.944059:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032375.944107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032375.944813:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835088640 00000100:00100000:2.0:1787032375.944825:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835088640 00000100:00100000:2.0:1787032375.944894:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835089152 00000100:00100000:2.0:1787032375.944898:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835089152 00000100:00100000:2.0:1787032375.944912:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835088768 00000100:00100000:2.0:1787032375.944914:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835088768 00000100:00100000:2.0:1787032375.944927:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835089024 00000100:00100000:2.0:1787032375.944930:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835089024 00000100:00100000:2.0:1787032375.944947:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:2.0:1787032375.944956:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2356:x1873838835088640:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032375.945058:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2356:x1873838835088640:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 103us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032375.945089:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:2.0:1787032375.945120:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:2.0:1787032375.945128:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2356:x1873838835089152:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032375.945156:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2356:x1873838835089152:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 29us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032375.945161:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:2.0:1787032375.945189:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:2.0:1787032375.945196:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2356:x1873838835088768:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032375.945235:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2356:x1873838835088768:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 27us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032375.945243:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:2.0:1787032375.945255:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:2.0:1787032375.945260:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2356:x1873838835089024:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032375.945285:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2356:x1873838835089024:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 25us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032375.945291:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:2.0:1787032375.945310:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835088896 00000100:00100000:2.0:1787032375.945313:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835088896 00000100:00100000:2.0:1787032375.945342:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835088512 00000100:00100000:2.0:1787032375.945345:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835088512 00000100:00100000:2.0:1787032375.945359:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:2.0:1787032375.945364:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2356:x1873838835088896:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032375.945391:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2356:x1873838835088896:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 27us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032375.945397:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:2.0:1787032375.945410:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:2.0:1787032375.945416:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2356:x1873838835088512:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032375.945440:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2356:x1873838835088512:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 24us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032375.945446:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00080000:0.0:1787032375.946206:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032375.946213:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032375.946217:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032375.947640:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835088384 00000100:00100000:3.0:1787032375.947656:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835088384 00000100:00100000:3.0:1787032375.947718:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 103 00000100:00100000:3.0:1787032375.947728:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+13:2356:x1873838835088384:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032375.947801:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+13:2356:x1873838835088384:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 75us (3896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032375.947809:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 103 00010000:00010000:3.0:1787032376.066302:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032377.089228:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787032377.492765:0:16252:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd3ba50a0 20000000:00000080:1.0:1787032377.492801:0:16252:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ccc36bb800 uarg=0000000000000000 20000000:01000000:1.0:1787032377.492871:0:16252:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787032377.492880:0:16252:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787032377.492886:0:16252:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787032377.498545:0:16253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787032377.498867:0:16252:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787032377.511885:0:16252:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787032377.512306:0:16252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512334:0:16252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512343:0:16252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512351:0:16252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512362:0:16252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512371:0:16252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512380:0:16252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512442:0:16252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512462:0:16252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 12 pid: 14231 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.512484:0:16252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857099648:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032377.512643:0:16252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 12 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512678:0:16252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 12 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.512688:0:16252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857099776:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032377.512723:0:16252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512732:0:16252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 18 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.512742:0:16252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857099904:0@lo:104: 00000100:00100000:2.0:1787032377.512810:0:16252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787032377.512876:0:16252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.512884:0:16252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 18 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.512893:0:16252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe09880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857100032:0@lo:104: 00000100:00100000:2.0:1787032377.512915:0:16252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032377.513148:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857099904 00000100:00100000:1.0:1787032377.513159:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857099904 00000100:00100000:1.0:1787032377.513219:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857100032 00000100:00100000:1.0:1787032377.513223:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857100032 00000100:00100000:1.0:1787032377.513244:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787032377.513254:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+4:16252:x1873838857099904:12345-0@lo:104: 00010000:00010000:1.0:1787032377.513273:0:14219:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032377.513340:0:14219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787032377.513347:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+4:16252:x1873838857099904:12345-0@lo:104: Request processed in 94us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032377.513356:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787032377.513384:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787032377.513390:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:16252:x1873838857100032:12345-0@lo:104: 00010000:00010000:1.0:1787032377.513398:0:14219:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032377.513448:0:14219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787032377.513453:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:16252:x1873838857100032:12345-0@lo:104: Request processed in 64us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032377.513460:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787032377.513885:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787032377.513903:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.513912:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:3.0:1787032377.513918:0:14225:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.513928:0:14225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032377.513942:0:14225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032377.513948:0:14225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787032377.514008:0:14225:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514016:0:14225:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787032377.514045:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514053:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc4cc6e00/0xcd047797ef1eaaf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1eaafa expref: -99 pid: 15540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514336:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032377.514341:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514349:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc7775800 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:3.0:1787032377.514352:0:14225:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514370:0:14225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032377.514377:0:14225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032377.514382:0:14225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787032377.514397:0:14225:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514403:0:14225:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787032377.514422:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514429:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1ea9b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea9bf expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514438:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032377.514440:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032377.514442:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032377.514449:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032377.514469:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857100160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787032377.514533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032377.514596:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b69d5fe-062a-4046-aadd-ee94584b57f2:3302:1873838857100288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787032377.514622:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032377.514656:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857100160 00000100:00100000:3.0:1787032377.514662:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857100160 00010000:00010000:3.0:1787032377.514689:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 19 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032377.514721:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857100288 00000100:00100000:3.0:1787032377.514724:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857100288 00010000:00010000:3.0:1787032377.514737:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 20 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032377.514749:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787032377.514756:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+20:3305:x1873838857100160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032377.514769:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032377.514775:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 20 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514784:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 20 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514807:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032377.514837:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+20:3305:x1873838857100160:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032377.514847:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787032377.514862:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787032377.514869:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3302:x1873838857100288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032377.514876:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032377.514881:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 19 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514888:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 19 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.514897:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032377.514931:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3302:x1873838857100288:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032377.514938:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787032377.515001:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857100160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787032377.515028:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8b69d5fe-062a-4046-aadd-ee94584b57f2:3302:1873838857100288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787032377.516433:0:16252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032377.516453:0:16252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 18 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.516469:0:16252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe0aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857100416:0@lo:104: 00000100:00100000:2.0:1787032377.516561:0:16252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032377.516626:0:16252:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdffe5bf00 going to sleep for 11 seconds 00010000:00010000:2.0:1787032377.516659:0:16252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef418600/0xcd047797ef1eaafa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1eaaf3 expref: 18 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.516679:0:16252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe08a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857099904:0@lo:104: 00010000:00010000:2.0:1787032377.516692:0:16252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdef419c00/0xcd047797ef1ea9bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1ea9b8 expref: 17 pid: 14230 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.516704:0:16252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857100032:0@lo:104: 00000100:00100000:3.0:1787032377.521052:0:14219:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787032377.524355:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857100416 00000100:00100000:3.0:1787032377.524376:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857100416 00000100:00100000:3.0:1787032377.524451:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787032377.524463:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdfb217050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:16252:x1873838857100416:12345-0@lo:104: 00010000:00010000:3.0:1787032377.524487:0:14219:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.524628:0:14219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787032377.524635:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdfb217050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8b69d5fe-062a-4046-aadd-ee94584b57f2+3:16252:x1873838857100416:12345-0@lo:104: Request processed in 175us (8074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032377.524644:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787032377.524711:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787032377.524719:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.524728:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1b5ac20) 10000000:00010000:3.0:1787032377.524734:0:14225:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.524744:0:14225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787032377.524775:0:14225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787032377.524782:0:14225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787032377.524832:0:14225:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.524839:0:14225:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787032377.524863:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.524870:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.148@tcp lock: ffff99cdef418c00/0xcd047797ef1ea96b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd047797ef1ea972 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.524892:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032377.524894:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787032377.524896:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032377.524922:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857100544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787032377.524989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032377.525052:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857100544 00000100:00100000:3.0:1787032377.525057:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857100544 00000100:00100000:1.0:1787032377.525242:0:16252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe0aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857100416:0@lo:104: 00000100:00100000:1.0:1787032377.527741:0:16252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe09180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857099648:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032377.527764:0:16252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16252:1873838857099776:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032377.527805:0:16252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.528525:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 17 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032377.529060:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787032377.529121:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffab4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:3303:x1873838857100544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032377.529147:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032377.529158:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 17 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.529203:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 17 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032377.529222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00010000:00010000:3.0:1787032377.529241:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc1536c00/0xcd047797ef1ea972 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd047797ef1ea96b expref: 17 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.529267:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032377.529312:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032377.529355:0:14222:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787032377.529370:0:14222:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787032377.529371:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffab4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:3303:x1873838857100544:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (4377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032377.529385:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787032377.529470:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835089280 00000100:00100000:3.0:1787032377.529479:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835089280 00010000:00010000:3.0:1787032377.529516:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 13 pid: 14231 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032377.529533:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835089408 00000100:00100000:3.0:1787032377.529537:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835089408 00010000:00010000:3.0:1787032377.529553:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 14 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032377.529573:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:0.0:1787032377.529589:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12a2a834-3f08-4bf2-9411-438402fb4594+14:2354:x1873838835089280:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032377.529611:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032377.529622:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 14 pid: 14231 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032377.529653:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 14 pid: 14231 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.529656:0:14221:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1787032377.529687:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc1a7ec00/0xcd047797ef1eac51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bf1 expref: 14 pid: 14231 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032377.529704:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032377.529758:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12a2a834-3f08-4bf2-9411-438402fb4594+13:2354:x1873838835089280:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 175us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032377.530307:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:3.0:1787032377.530324:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12a2a834-3f08-4bf2-9411-438402fb4594+13:2354:x1873838835089408:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787032377.530336:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032377.530342:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 13 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530355:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 13 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530389:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7800/0xcd047797ef1eac19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2b8f expref: 13 pid: 14228 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530406:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530417:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530437:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530445:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530452:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530459:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530465:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032377.530471:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.530481:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032377.530612:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00010000:00010000:1.0:1787032377.530686:0:16252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032377.530700:0:16252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032377.531360:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8b69d5fe-062a-4046-aadd-ee94584b57f2:3303:1873838857100544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787032377.531443:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.531471:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cdc4cc7c00/0xcd047797ef1eac7b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032377.531505:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032377.531585:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12a2a834-3f08-4bf2-9411-438402fb4594+11:2354:x1873838835089408:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 1264us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032377.531597:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00010000:00010000:3.0:1787032378.113544:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787032378.565017:0:14233:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787032378.565027:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdefc56000 from 10 10000000:01000000:1.0:1787032378.565034:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787032378.565119:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774000/0xcd047797ef1eac82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.565132:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7774000/0xcd047797ef1eac82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.565144:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7774000/0xcd047797ef1eac82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032378.565175:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857100672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.565276:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032378.565329:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032378.565553:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857100672 00000100:00100000:0.0:1787032378.565563:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857100672 00000100:00100000:0.0:1787032378.565630:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787032378.565639:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+16:14233:x1873838857100672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787032378.565656:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032378.565671:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc1a7fc00/0xcd047797ef1eac89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1eac82 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032378.565698:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc1a7fc00/0xcd047797ef1eac89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1eac82 expref: 17 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032378.565710:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc1a7fc00/0xcd047797ef1eac89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1eac82 expref: 17 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032378.565720:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7fc00, rc 0) 00000100:00100000:0.0:1787032378.565770:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:14233:x1873838857100672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032378.565777:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787032378.568413:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857100672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032378.568442:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7774000/0xcd047797ef1eac82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eac89 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032378.568455:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7774000/0xcd047797ef1eac82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1eac89 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032378.568554:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857100800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032378.568607:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032378.568653:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc80e1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787032378.568702:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857100800 00000100:00100000:0.0:1787032378.568709:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857100800 00000100:00100000:0.0:1787032378.568761:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787032378.568771:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:14233:x1873838857100800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032378.569099:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef006c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:14233:x1873838857100800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032378.569109:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787032378.570248:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857100800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032378.570301:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857100928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787032378.570363:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032378.570404:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc80e1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787032378.570450:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857100928 00000100:00100000:1.0:1787032378.570456:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857100928 00000100:00100000:1.0:1787032378.570508:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787032378.570516:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:14233:x1873838857100928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.570715:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef007450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:14233:x1873838857100928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.570722:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787032378.570797:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857100928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787032378.572492:0:16275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787032378.573179:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787032378.573201:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787032378.573213:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7774000/0xcd047797ef1eac82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eac89 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.573224:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7774000/0xcd047797ef1eac82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eac89 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032378.573236:0:14233:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787032378.573238:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdc9d79800 from 10 10000000:01000000:1.0:1787032378.573241:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787032378.573282:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1eac90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.573290:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1eac90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.573300:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1eac90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032378.573325:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.573409:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032378.573445:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032378.573516:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857101056 00000100:00100000:0.0:1787032378.573525:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857101056 00000100:00100000:0.0:1787032378.573575:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787032378.573584:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+17:14233:x1873838857101056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787032378.573597:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032378.573610:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc1a7fe00/0xcd047797ef1eac97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1eac90 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032378.573632:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc1a7fe00/0xcd047797ef1eac97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1eac90 expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032378.573642:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc1a7fe00/0xcd047797ef1eac97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1eac90 expref: 18 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032378.573650:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7fe00, rc 0) 00000100:00100000:0.0:1787032378.573699:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:14233:x1873838857101056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032378.573707:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787032378.574978:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032378.575016:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1eac90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eac97 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032378.575028:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1eac90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1eac97 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032378.576239:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787032378.576303:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032378.576347:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc80e1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787032378.576470:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857101184 00000100:00100000:0.0:1787032378.576486:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857101184 00000100:00100000:0.0:1787032378.576536:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787032378.576545:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:14233:x1873838857101184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032378.576829:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:14233:x1873838857101184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032378.576837:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787032378.576887:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787032378.576922:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787032378.576962:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032378.576982:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787032378.577032:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857101312 00000100:00100000:1.0:1787032378.577037:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857101312 00000100:00100000:1.0:1787032378.577111:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787032378.577119:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:14233:x1873838857101312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.577278:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:14233:x1873838857101312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.577285:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787032378.577332:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787032378.578005:0:16276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787032378.578091:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787032378.578110:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787032378.578121:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1eac90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eac97 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.578131:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775e00/0xcd047797ef1eac90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eac97 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787032378.578141:0:14233:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787032378.578144:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff99cdf4cdf000 from 10 10000000:01000000:1.0:1787032378.578146:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787032378.578176:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1eac9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.578183:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1eac9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.578192:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1eac9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032378.578216:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.578252:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032378.578277:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032378.578290:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857101440 00000100:00100000:1.0:1787032378.578294:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857101440 00000100:00100000:1.0:1787032378.578316:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787032378.578322:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+18:14233:x1873838857101440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032378.578332:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032378.578347:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774800/0xcd047797ef1eaca5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd047797ef1eac9e expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.578367:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774800/0xcd047797ef1eaca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd047797ef1eac9e expref: 19 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.578377:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774800/0xcd047797ef1eaca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd047797ef1eac9e expref: 19 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.578385:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774800, rc 0) 00000100:00100000:1.0:1787032378.578415:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef005050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:14233:x1873838857101440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.578421:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787032378.578452:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032378.578463:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1eac9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaca5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.578485:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1eac9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd047797ef1eaca5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032378.578534:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.578558:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032378.578571:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde487fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787032378.578581:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857101568 00000100:00100000:1.0:1787032378.578584:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857101568 00000100:00100000:1.0:1787032378.578601:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787032378.578606:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:14233:x1873838857101568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.578807:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef007050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:14233:x1873838857101568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.578814:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787032378.578842:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.578865:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.578898:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032378.578911:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdcb745b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787032378.578922:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857101696 00000100:00100000:1.0:1787032378.578925:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857101696 00000100:00100000:1.0:1787032378.578940:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787032378.578946:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:14233:x1873838857101696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.579095:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef004850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:14233:x1873838857101696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.579102:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787032378.579139:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8b69d5fe-062a-4046-aadd-ee94584b57f2:14233:1873838857101696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787032378.584618:0:16277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787032378.585908:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787032378.585947:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787032378.585959:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1eac9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaca5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.585971:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.148@tcp lock: ffff99cdc7775800/0xcd047797ef1eac9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd047797ef1eaca5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032378.691625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032378.696510:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835089536 00000100:00100000:1.0:1787032378.696529:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835089536 00000100:00100000:1.0:1787032378.697495:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 113 00000100:00100000:1.0:1787032378.697506:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+11:13708:x1873838835089536:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787032378.697524:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032378.697541:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdc7774200/0xcd047797ef1eacac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c22 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.697569:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdc7774200/0xcd047797ef1eacac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c22 expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.697579:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdc7774200/0xcd047797ef1eacac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c22 expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032378.697588:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc7774200, rc 0) 00000100:00100000:1.0:1787032378.697663:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+12:13708:x1873838835089536:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 Request processed in 158us (6047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.697670:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 113 00000100:00100000:3.0:1787032378.704454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032378.705455:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835089664 00000100:00100000:1.0:1787032378.705478:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835089664 00000100:00100000:1.0:1787032378.705530:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 114 00000100:00100000:1.0:1787032378.705541:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+12:13708:x1873838835089664:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.705851:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef004c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+12:13708:x1873838835089664:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 Request processed in 311us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.705859:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 114 00000100:00100000:3.0:1787032378.724688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032378.724769:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835089792 00000100:00100000:1.0:1787032378.724780:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835089792 00000100:00100000:1.0:1787032378.724853:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 115 00000100:00100000:1.0:1787032378.724865:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+12:13708:x1873838835089792:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.725186:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef006450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+12:13708:x1873838835089792:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 Request processed in 322us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.725195:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 115 00000100:00100000:2.0:1787032378.737210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032378.737348:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835089920 00000100:00100000:3.0:1787032378.737359:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835089920 00000100:00100000:3.0:1787032378.737417:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 116 00000100:00100000:3.0:1787032378.737428:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+12:13708:x1873838835089920:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787032378.737444:0:14228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032378.737462:0:14228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cdef418e00/0xcd047797ef1eacb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c29 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032378.737506:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cdef418e00/0xcd047797ef1eacb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c29 expref: 13 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032378.737517:0:14228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cdef418e00/0xcd047797ef1eacb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c29 expref: 13 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032378.737525:0:14228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418e00, rc 0) 00000100:00100000:3.0:1787032378.737593:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+13:13708:x1873838835089920:12345-192.168.201.48@tcp:101:ll_cfg_requeue.0 Request processed in 166us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032378.737602:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 116 00000100:00100000:3.0:1787032378.743417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032378.744392:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835090048 00000100:00100000:1.0:1787032378.744405:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835090048 00000100:00100000:1.0:1787032378.744459:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 117 00000100:00100000:1.0:1787032378.744477:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+13:13708:x1873838835090048:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.744773:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:12a2a834-3f08-4bf2-9411-438402fb4594+13:13708:x1873838835090048:12345-192.168.201.48@tcp:501:ll_cfg_requeue.0 Request processed in 304us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.744781:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 117 00000100:00100000:3.0:1787032378.746357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032378.746643:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835090176 00000100:00100000:1.0:1787032378.746651:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835090176 00000100:00100000:1.0:1787032378.746701:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 118 00000100:00100000:1.0:1787032378.746710:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:13708:x1873838835090176:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787032378.746924:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:13708:x1873838835090176:12345-192.168.201.48@tcp:503:ll_cfg_requeue.0 Request processed in 214us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032378.746933:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 118 00000100:00100000:3.0:1787032379.137720:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857101824:0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.137787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032379.137836:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857102336:0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.137857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032379.137881:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787032379.137887:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857101952:0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.137922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032379.137959:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857102080:0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.137982:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032379.138001:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787032379.138006:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857102208:0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.138026:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032379.138087:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857101824 00000100:00100000:3.0:1787032379.138094:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857101824 00000100:00100000:3.0:1787032379.138150:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857101952 00000100:00100000:3.0:1787032379.138154:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857101952 00000100:00100000:3.0:1787032379.138173:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787032379.138182:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857101824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.138233:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857101824:12345-0@lo:400:kworker.0 Request processed in 53us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032379.138240:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787032379.138499:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787032379.138505:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857101952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.138536:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857101952:12345-0@lo:400:kworker.0 Request processed in 31us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032379.138542:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787032379.138563:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857102336 00000100:00100000:3.0:1787032379.138566:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857102336 00000100:00100000:3.0:1787032379.138585:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857102080 00000100:00100000:3.0:1787032379.138587:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857102080 00000100:00100000:3.0:1787032379.138596:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857102208 00000100:00100000:3.0:1787032379.138598:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857102208 00000100:00100000:3.0:1787032379.138612:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787032379.138618:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857102336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.138712:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1873838857102336:12345-0@lo:400:kworker.0 Request processed in 94us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032379.138718:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787032379.138731:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787032379.138736:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857102080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.138768:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873838857102080:12345-0@lo:400:kworker.0 Request processed in 32us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032379.138774:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787032379.138784:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787032379.138790:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857102208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.138815:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873838857102208:12345-0@lo:400:kworker.0 Request processed in 25us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032379.138821:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787032379.138867:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1873838857102208:0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.138883:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873838857102080:0@lo:400:kworker.0 00010000:00010000:1.0:1787032379.139030:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032379.140032:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857101952:0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.140562:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857101824:0@lo:400:kworker.0 00000100:00100000:3.0:1787032379.140582:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1873838857102336:0@lo:400:kworker.0 00000100:00080000:0.0:1787032379.141430:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787032379.141438:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787032379.141441:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787032379.145616:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857102464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032379.145704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032379.145778:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857102464 00000100:00100000:3.0:1787032379.145787:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857102464 00000100:00100000:3.0:1787032379.145845:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787032379.145855:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857102464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787032379.145891:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032379.145950:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1873838857102464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032379.145957:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787032379.146002:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1873838857102464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032380.161350:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdffe08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857102592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787032380.161473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032380.161632:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857102592 00000100:00100000:3.0:1787032380.161642:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857102592 00000100:00100000:3.0:1787032380.161704:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787032380.161707:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032380.161715:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857102592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787032380.161762:0:14875:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787032380.161832:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873838857102592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032380.161856:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787032380.162154:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdffe08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1873838857102592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032381.062286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032381.062342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032381.062387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032381.062538:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835090560 00000100:00100000:2.0:1787032381.062554:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835090560 00000100:00100000:2.0:1787032381.062648:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:2.0:1787032381.062661:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2357:x1873838835090560:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032381.062774:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2357:x1873838835090560:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 117us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032381.062783:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00080000:2.0:1787032381.062819:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787032381.063180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032381.063211:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032381.063251:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835091072 00000100:00100000:2.0:1787032381.063256:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835091072 00000100:00100000:2.0:1787032381.063293:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:2.0:1787032381.063302:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2357:x1873838835091072:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032381.063345:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2357:x1873838835091072:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 45us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032381.063352:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00080000:2.0:1787032381.063386:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787032381.066703:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835090304 00000100:00100000:3.0:1787032381.066733:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835090304 00000100:00100000:3.0:1787032381.066840:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 119 00000100:00100000:3.0:1787032381.066854:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+13:2357:x1873838835090304:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032381.066967:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:12a2a834-3f08-4bf2-9411-438402fb4594+13:2357:x1873838835090304:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 116us (4701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032381.066976:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 119 00000100:00100000:1.0:1787032381.068169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032381.068209:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032381.068242:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835090688 00000100:00100000:1.0:1787032381.068249:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835090688 00000100:00100000:1.0:1787032381.068306:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835090944 00000100:00100000:1.0:1787032381.068309:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835090944 00000100:00100000:1.0:1787032381.068330:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:1.0:1787032381.068339:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2357:x1873838835090688:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032381.068483:0:14873:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787032381.068494:0:14873:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787032381.068644:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:2.0:1787032381.068653:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2357:x1873838835090944:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:1.0:1787032381.068762:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2357:x1873838835090688:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 422us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032381.068770:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:2.0:1787032381.069205:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2357:x1873838835090944:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 551us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032381.069213:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00080000:2.0:1787032381.072332:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787032381.072348:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032381.072981:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835090816 00000100:00100000:0.0:1787032381.072998:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835090816 00000100:00100000:0.0:1787032381.073126:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835090432 00000100:00100000:0.0:1787032381.073131:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835090432 00000100:00100000:0.0:1787032381.073162:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:0.0:1787032381.073174:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2357:x1873838835090816:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032381.073283:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2357:x1873838835090816:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 111us (10894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032381.073292:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:0.0:1787032381.073313:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:0.0:1787032381.073318:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2357:x1873838835090432:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:0.0:1787032381.073343:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2357:x1873838835090432:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 24us (10131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032381.073372:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00080000:2.0:1787032381.076204:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787032381.187021:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032381.781968:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032381.782133:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835091200 00000100:00100000:0.0:1787032381.782149:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835091200 00000100:00100000:0.0:1787032381.782250:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:0.0:1787032381.782261:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:14361:x1873838835091200:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032381.782287:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032381.782318:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f200/0xcd047797ef1eacba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c30 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.782400:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.782430:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.782446:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.782462:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.782470:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.782477:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.784523:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e400/0xcd047797ef1eaccf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.784569:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e400/0xcd047797ef1eaccf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.784586:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e400/0xcd047797ef1eaccf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032381.784691:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787032381.784695:0:14236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032381.784796:0:14236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e400/0xcd047797ef1eaccf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.785938:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.785952:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.785960:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.786129:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7f800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032381.786135:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.786145:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.786166:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864600) 00010000:00010000:0.0:1787032381.786170:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032381.786176:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.786938:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eacc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.786962:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793326:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793338:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793345:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7f400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032381.793352:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793364:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793388:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032381.793392:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032381.793398:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793406:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1eacc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793505:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f200/0xcd047797ef1eacba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c30 expref: 8 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793556:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e400/0xcd047797ef1eaccf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c30 expref: 7 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.793564:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:0.0:1787032381.793566:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787032381.793569:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7e400, rc 0) 00000100:00100000:0.0:1787032381.793680:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:14361:x1873838835091200:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 11418us (11719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032381.793690:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:1.0:1787032381.798276:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032381.799001:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835091456 00000100:00100000:3.0:1787032381.799016:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835091456 00000100:00100000:3.0:1787032381.799137:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:3.0:1787032381.799151:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:14361:x1873838835091456:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032381.799190:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032381.799221:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418400/0xcd047797ef1eacd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c37 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.799320:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.799339:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.799353:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.803699:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.803741:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.803755:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804303:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1eaceb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804313:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1eaceb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804320:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1eaceb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032381.804331:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787032381.804601:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804610:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804617:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804623:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032381.804628:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804635:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804658:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99cdc4f0a800) 00010000:00010000:3.0:1787032381.804661:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032381.804666:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804673:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1eacdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804685:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804691:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804696:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804702:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032381.804705:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804710:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804716:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99cdcba3af00) 00010000:00010000:3.0:1787032381.804718:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032381.804721:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.804726:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1eace4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.805131:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418400/0xcd047797ef1eacd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c37 expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.805148:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418a00/0xcd047797ef1eaceb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c37 expref: 9 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.805155:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdcba3a900) 00010000:00010000:3.0:1787032381.805157:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032381.805159:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418a00, rc 0) 00000100:00100000:3.0:1787032381.805242:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14361:x1873838835091456:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 6093us (6981us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787032381.805250:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:1.0:1787032381.814247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032381.814503:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835091584 00000100:00100000:0.0:1787032381.814513:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835091584 00000100:00100000:0.0:1787032381.814578:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:0.0:1787032381.814588:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14361:x1873838835091584:12345-192.168.201.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787032381.814693:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14361:x1873838835091584:12345-192.168.201.48@tcp:59:lhsmtool_posix.0 Request processed in 106us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032381.814702:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:2.0:1787032381.848431:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032381.848514:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835091712 00000100:00100000:3.0:1787032381.848525:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835091712 00000100:00100000:3.0:1787032381.848594:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032381.848605:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14367:x1873838835091712:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032381.848627:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032381.848649:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418400/0xcd047797ef1eacf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c3e expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.848722:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.848739:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.848752:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.848781:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.848789:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.848796:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849304:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849314:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849321:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849327:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032381.849332:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849341:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849354:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864600) 00010000:00010000:2.0:1787032381.849358:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032381.849369:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849376:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419e00/0xcd047797ef1ead00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849392:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849399:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849406:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849423:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef418c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032381.849427:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849433:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849442:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99cdcba3af00) 00010000:00010000:2.0:1787032381.849445:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032381.849448:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849454:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418c00/0xcd047797ef1ead07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849486:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418400/0xcd047797ef1eacf9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c3e expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849509:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864600) 00010000:00010000:2.0:1787032381.849511:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032381.849516:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418400/0xcd047797ef1eacf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c3e expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.849525:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418400, rc 0) 00000100:00100000:2.0:1787032381.849588:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14367:x1873838835091712:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 984us (1177us total) trans 0 rc 301/301 00000100:00100000:2.0:1787032381.849596:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:1.0:1787032381.853312:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032381.853462:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835091840 00000100:00100000:3.0:1787032381.853474:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835091840 00000100:00100000:3.0:1787032381.853532:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:3.0:1787032381.853542:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14367:x1873838835091840:12345-192.168.201.48@tcp:700:lfs.0 00000100:00100000:3.0:1787032381.853708:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14367:x1873838835091840:12345-192.168.201.48@tcp:700:lfs.0 Request processed in 166us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032381.853718:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:1.0:1787032381.855724:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032381.855804:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835092096 00000100:00100000:3.0:1787032381.855813:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835092096 00000100:00100000:3.0:1787032381.855872:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:3.0:1787032381.855882:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14367:x1873838835092096:12345-192.168.201.48@tcp:36:lfs.0 00010000:00010000:3.0:1787032381.855935:0:14237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032381.855962:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eac3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2bb9 expref: 9 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.855981:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864600) 00010000:00010000:3.0:1787032381.855987:0:14237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032381.856520:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.856543:0:14237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 5 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.856553:0:14237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.856588:0:14237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 5 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.856602:0:14237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 5 pid: 14238 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032381.856619:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef135c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14237:1873838857102720:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032381.856698:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc34a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787032381.859646:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032381.861711:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835092224 00000100:00100000:0.0:1787032381.861728:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835092224 00010000:00010000:0.0:1787032381.861781:0:14221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 6 pid: 14238 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032381.861834:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:0.0:1787032381.861844:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2354:x1873838835092224:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032381.861869:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032381.861891:0:14221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 6 pid: 14238 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.861905:0:14221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 6 pid: 14238 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.861930:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864600) 00010000:00010000:0.0:1787032381.861937:0:14221:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.861947:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.861956:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.861979:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032381.862064:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2354:x1873838835092224:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 221us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032381.862100:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00010000:00010000:3.0:1787032381.864294:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc7775c00/0xcd047797ef1eac74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c1b expref: 5 pid: 14238 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032381.864320:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef135c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14237:1873838857102720:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032381.864350:0:14237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.864362:0:14237:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.864369:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.864402:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.864443:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.864455:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787032381.867521:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787032381.867544:0:14237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.867554:0:14237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.867561:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.867567:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032381.867572:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.867579:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.867595:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdc3864600) 00010000:00010000:3.0:1787032381.867598:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032381.867603:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.867610:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead0e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032381.867648:0:14237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d6319dd reply state 000000003a75cfcc transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032381.867658:0:14237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787032381.867874:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+10:14367:x1873838835092096:12345-192.168.201.48@tcp:36:lfs.0 Request processed in 11989us (12155us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787032381.867884:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 19 00010000:00010000:0.0:1787032381.874210:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.874231:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.874239:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.874246:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032381.874251:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.874274:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.874291:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99cdcba3aa00) 00010000:00010000:0.0:1787032381.874294:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032381.874299:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.874305:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419400/0xcd047797ef1ead15 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032381.936881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032381.936991:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835092352 00000100:00100000:0.0:1787032381.937677:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835092352 00000100:00100000:1.0:1787032381.937833:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:1.0:1787032381.937845:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:14375:x1873838835092352:12345-192.168.201.48@tcp:101:lctl.0 00010000:00010000:1.0:1787032381.937869:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032381.937894:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c45 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.937981:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031200/0xcd047797ef1ead23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.937995:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031200/0xcd047797ef1ead23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.938035:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031200/0xcd047797ef1ead23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032381.938112:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787032381.938116:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787032381.938156:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031200/0xcd047797ef1ead23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.938181:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c45 expref: 11 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.938201:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031200/0xcd047797ef1ead23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c45 expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.938211:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032381.938214:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787032381.938218:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0031200, rc 0) 00000100:00100000:1.0:1787032381.938287:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+10:14375:x1873838835092352:12345-192.168.201.48@tcp:101:lctl.0 Request processed in 444us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032381.938295:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:2.0:1787032381.960730:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032381.960869:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835092480 00000100:00100000:3.0:1787032381.960879:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835092480 00000100:00100000:3.0:1787032381.960998:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:3.0:1787032381.961026:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+5:14376:x1873838835092480:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:3.0:1787032381.961050:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032381.961111:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c4c expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.961180:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ead31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.961195:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ead31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032381.961207:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ead31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032381.961614:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787032381.961620:0:14237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032381.961655:0:14237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ead31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.961688:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419a00/0xcd047797ef1ead2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c4c expref: 7 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.961711:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef418800/0xcd047797ef1ead31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c4c expref: 6 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.961721:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032381.961725:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032381.961729:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef418800, rc 0) 00000100:00100000:2.0:1787032381.961804:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+6:14376:x1873838835092480:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 796us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032381.961831:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 21 00000100:00100000:3.0:1787032381.965042:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032381.965253:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835092608 00000100:00100000:2.0:1787032381.965262:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835092608 00000100:00100000:2.0:1787032381.965324:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:2.0:1787032381.965334:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+6:14376:x1873838835092608:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032381.965354:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032381.965376:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1ead38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c53 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965474:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965488:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965500:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965515:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965523:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965530:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965630:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1ead4d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965657:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1ead4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965665:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1ead4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032381.965704:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787032381.965708:0:14236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032381.965729:0:14236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1ead4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965742:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965749:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965756:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965763:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032381.965768:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965776:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965789:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032381.965793:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032381.965798:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965815:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1ead3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965828:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965835:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965842:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965847:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032381.965864:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965871:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965879:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99cdc3864b00) 00010000:00010000:2.0:1787032381.965883:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032381.965886:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965892:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1ead46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965922:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1ead38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c53 expref: 8 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965950:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1ead4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c53 expref: 7 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.965958:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cdc3864f00) 00010000:00010000:2.0:1787032381.965960:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787032381.965962:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7800, rc 0) 00000100:00100000:2.0:1787032381.966275:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+7:14376:x1873838835092608:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 885us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032381.966285:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 22 00000100:00100000:3.0:1787032381.971216:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032381.971388:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835092864 00000100:00100000:2.0:1787032381.971398:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835092864 00000100:00100000:2.0:1787032381.971471:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:2.0:1787032381.971482:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+7:14376:x1873838835092864:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:2.0:1787032381.971503:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032381.971524:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ead54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c5a expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032381.971638:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787032381.971754:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ead54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c5a expref: 9 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.971768:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:2.0:1787032381.971772:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032381.971778:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1ead54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c5a expref: 9 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.971811:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7c00, rc 0) 00000100:00100000:2.0:1787032381.971879:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+8:14376:x1873838835092864:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 398us (675us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787032381.971887:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 23 00000100:00100000:0.0:1787032381.975229:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032381.975319:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835093120 00000100:00100000:1.0:1787032381.975329:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835093120 00000100:00100000:1.0:1787032381.975395:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 24 00000100:00100000:1.0:1787032381.975407:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+8:14376:x1873838835093120:12345-192.168.201.48@tcp:36:lfs.0 00010000:00010000:1.0:1787032381.975483:0:14238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032381.975510:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1ead4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c53 expref: 8 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.975529:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cdc3864f00) 00010000:00010000:1.0:1787032381.975540:0:14238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787032381.975563:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.975576:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032381.975584:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032381.975793:0:14238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005cdc8f24 reply state 000000002970536f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032381.975804:0:14238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787032381.975816:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787032381.975909:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+9:14376:x1873838835093120:12345-192.168.201.48@tcp:36:lfs.0 Request processed in 503us (688us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787032381.975917:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 24 00010000:00010000:2.0:1787032381.977989:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.978004:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.978012:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.978019:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032381.978023:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.978031:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.978045:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cdce1ff500) 00010000:00010000:2.0:1787032381.978048:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787032381.978052:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032381.978059:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1ead62 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032381.979144:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032381.979217:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835093376 00000100:00100000:1.0:1787032381.979226:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835093376 00000100:00100000:1.0:1787032381.979273:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:1.0:1787032381.979281:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+8:14376:x1873838835093376:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:1.0:1787032381.979546:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+9:14376:x1873838835093376:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 264us (407us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787032381.979553:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:3.0:1787032381.987291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032381.987382:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835093632 00000100:00100000:0.0:1787032381.987392:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835093632 00000100:00100000:0.0:1787032381.987461:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 25 00000100:00100000:0.0:1787032381.987471:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+9:14376:x1873838835093632:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032381.987496:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032381.987516:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1ead69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c61 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987586:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987600:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987612:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987640:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987648:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987654:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032381.987780:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787032381.987888:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987898:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987905:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987911:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7e600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032381.987916:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987923:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987937:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032381.987940:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032381.987945:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987960:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1ead70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987975:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987981:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987987:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.987992:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7f400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032381.988012:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.988020:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.988028:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032381.988031:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032381.988034:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.988040:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.988367:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1ead69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c61 expref: 11 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.988393:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032381.988395:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787032381.988400:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1ead69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c61 expref: 11 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.988420:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7f800, rc 0) 00000100:00100000:0.0:1787032381.988551:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+10:14376:x1873838835093632:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 1080us (1269us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787032381.988560:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 25 00000100:00100000:2.0:1787032381.991890:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032381.991982:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835093760 00000100:00100000:0.0:1787032381.991992:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835093760 00000100:00100000:0.0:1787032381.992099:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 26 00000100:00100000:0.0:1787032381.992111:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+10:14376:x1873838835093760:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:0.0:1787032381.992135:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032381.992157:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f200/0xcd047797ef1ead85 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c68 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.992243:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.992257:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.992268:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032381.992316:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787032381.992326:0:14237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032381.992352:0:14237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.992376:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f200/0xcd047797ef1ead85 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 12 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.992394:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 11 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032381.992403:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032381.992407:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787032381.992422:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7ea00, rc 0) 00000100:00100000:0.0:1787032381.992470:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+11:14376:x1873838835093760:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 361us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032381.992477:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 26 00000100:00100000:2.0:1787032381.996271:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032381.996368:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835093888 00000100:00100000:1.0:1787032381.996378:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835093888 00000100:00100000:1.0:1787032381.996440:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:1.0:1787032381.996450:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+11:14376:x1873838835093888:12345-192.168.201.48@tcp:37:lfs.0 00000100:00100000:1.0:1787032382.001303:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1efce990-7f6d-4d80-b404-6b6f14248bce+11:14376:x1873838835093888:12345-192.168.201.48@tcp:37:lfs.0 Request processed in 4841us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032382.001319:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:2.0:1787032382.004792:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032382.004927:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835094144 00000100:00100000:3.0:1787032382.004954:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835094144 00000100:00100000:3.0:1787032382.005202:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:3.0:1787032382.005213:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc76e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+11:14376:x1873838835094144:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032382.005531:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc76e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1efce990-7f6d-4d80-b404-6b6f14248bce+12:14376:x1873838835094144:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 319us (746us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787032382.005540:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:2.0:1787032382.056781:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.056893:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835094272 00000100:00100000:0.0:1787032382.056906:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835094272 00000100:00100000:0.0:1787032382.056976:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:0.0:1787032382.056988:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+10:14382:x1873838835094272:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032382.057024:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032382.057047:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1ead93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c6f expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057159:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057175:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057205:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057221:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057229:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057236:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057355:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f000/0xcd047797ef1eada8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057364:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f000/0xcd047797ef1eada8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057371:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f000/0xcd047797ef1eada8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032382.057405:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787032382.057420:0:14236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032382.057465:0:14236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f000/0xcd047797ef1eada8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057477:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057484:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057500:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057507:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7f400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.057511:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057519:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057531:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:0.0:1787032382.057534:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032382.057538:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057544:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f400/0xcd047797ef1ead9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057557:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057563:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057569:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057574:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7e600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.057577:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057594:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057603:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032382.057605:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032382.057607:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057613:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eada1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057649:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1ead93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c6f expref: 12 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057664:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f000/0xcd047797ef1eada8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c6f expref: 11 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.057671:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032382.057673:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787032382.057675:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7f000, rc 0) 00000100:00100000:0.0:1787032382.057753:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+11:14382:x1873838835094272:12345-192.168.201.48@tcp:101:bash.0 Request processed in 767us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.057762:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:0.0:1787032382.061376:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.061476:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835094528 00000100:00100000:1.0:1787032382.061486:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835094528 00000100:00100000:1.0:1787032382.061546:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:1.0:1787032382.061555:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+11:14382:x1873838835094528:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:1.0:1787032382.061576:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032382.061597:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eadaf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c76 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.061723:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.061739:0:14238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 11 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.061749:0:14238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.061806:0:14238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 11 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.061821:0:14238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 11 pid: 14237 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.061836:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1873838857102848:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032382.061940:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3165240 going to sleep for 11 seconds 00000100:00100000:3.0:1787032382.065468:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.065600:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1873838857102848:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032382.065632:0:14238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.065711:0:16254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835094656 00000100:00100000:0.0:1787032382.065719:0:16254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835094656 00010000:00010000:0.0:1787032382.065757:0:16254:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 12 pid: 14237 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.065825:0:16254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:0.0:1787032382.065834:0:16254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1efce990-7f6d-4d80-b404-6b6f14248bce+12:2355:x1873838835094656:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032382.065860:0:16254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032382.065867:0:16254:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 12 pid: 14237 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.065880:0:16254:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 12 pid: 14237 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.065905:0:16254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1ead8c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c68 expref: 12 pid: 14237 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.065921:0:16254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032382.065926:0:16254:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.065937:0:16254:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.065945:0:16254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.065972:0:16254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032382.066044:0:16254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1efce990-7f6d-4d80-b404-6b6f14248bce+11:2355:x1873838835094656:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 209us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.066052:0:16254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00010000:00010000:1.0:1787032382.066359:0:14238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.066367:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.066392:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.066402:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.066422:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067327:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067345:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067354:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032382.067366:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787032382.067395:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067401:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067407:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067425:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032382.067429:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067436:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067446:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:1.0:1787032382.067449:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032382.067454:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067460:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadb6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787032382.067472:0:14238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000716319dc reply state 000000008cd8a187 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.067486:0:14238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787032382.067520:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eadaf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 14 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067536:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 13 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.067544:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:1.0:1787032382.067547:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787032382.067549:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030600, rc 0) 00000100:00100000:1.0:1787032382.067793:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+14:14382:x1873838835094528:12345-192.168.201.48@tcp:101:bash.0 Request processed in 6237us (6424us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787032382.067803:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 28 00010000:00010000:0.0:1787032382.079059:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.079116:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.079124:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.079130:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.079135:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.079143:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.079161:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99cdce1ff900) 00010000:00010000:0.0:1787032382.079164:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032382.079169:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.079175:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030200/0xcd047797ef1eadbd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032382.084418:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.084568:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835094784 00000100:00100000:0.0:1787032382.084579:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835094784 00000100:00100000:0.0:1787032382.084686:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:0.0:1787032382.084697:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+13:14382:x1873838835094784:12345-192.168.201.48@tcp:101:bash.0 00010000:00010000:0.0:1787032382.084731:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032382.084756:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1eadd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c7d expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.084879:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.084895:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.084907:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032382.084955:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787032382.084959:0:14237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032382.084983:0:14237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.085006:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.085042:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ea00/0xcd047797ef1eadd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 15 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.085062:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 14 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.085292:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:0.0:1787032382.085296:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032382.085299:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7f800, rc 0) 00000100:00100000:1.0:1787032382.085691:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+14:14382:x1873838835094784:12345-192.168.201.48@tcp:101:bash.0 Request processed in 992us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032382.085701:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 29 00000100:00100000:2.0:1787032382.088929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.089174:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835095040 00000100:00100000:1.0:1787032382.089185:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835095040 00000100:00100000:1.0:1787032382.089281:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:1.0:1787032382.089291:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+14:14382:x1873838835095040:12345-192.168.201.48@tcp:35:bash.0 00000100:00100000:1.0:1787032382.089673:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+15:14382:x1873838835095040:12345-192.168.201.48@tcp:35:bash.0 Request processed in 382us (752us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787032382.089681:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:2.0:1787032382.166811:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.166918:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835095296 00000100:00100000:1.0:1787032382.166928:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835095296 00000100:00100000:1.0:1787032382.167003:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 30 00000100:00100000:1.0:1787032382.167026:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+15:14392:x1873838835095296:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032382.167051:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032382.167110:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eade0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c84 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032382.167244:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787032382.167362:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eade0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c84 expref: 17 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.167377:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cdce1ff800) 00010000:00010000:1.0:1787032382.167380:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787032382.167385:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eade0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c84 expref: 17 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.167400:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030800, rc 0) 00000100:00100000:1.0:1787032382.167495:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+16:14392:x1873838835095296:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 472us (697us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787032382.167502:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 30 00000100:00100000:2.0:1787032382.170935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032382.171115:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835095552 00000100:00100000:3.0:1787032382.171125:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835095552 00000100:00100000:3.0:1787032382.171175:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:3.0:1787032382.171185:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+16:14392:x1873838835095552:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:3.0:1787032382.171463:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+17:14392:x1873838835095552:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 278us (539us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787032382.171471:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:3.0:1787032382.208863:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.209019:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835095808 00000100:00100000:1.0:1787032382.209032:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835095808 00000100:00100000:1.0:1787032382.209168:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 31 00000100:00100000:1.0:1787032382.209179:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+17:14395:x1873838835095808:12345-192.168.201.48@tcp:101:lfs.0 00010000:00010000:1.0:1787032382.209203:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032382.209226:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eadee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c8b expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.209343:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadf5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.209358:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.209370:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787032382.209382:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787032382.209515:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eadee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c8b expref: 20 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.209534:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c8b expref: 19 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.209543:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:1.0:1787032382.209547:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787032382.209550:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0031800, rc 0) 00000100:00100000:1.0:1787032382.209601:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:14395:x1873838835095808:12345-192.168.201.48@tcp:101:lfs.0 Request processed in 425us (758us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787032382.209609:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 31 00010000:00010000:0.0:1787032382.210084:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787032382.212837:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.212940:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835095936 00000100:00100000:0.0:1787032382.212950:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835095936 00000100:00100000:0.0:1787032382.213024:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00100000:0.0:1787032382.213035:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:14395:x1873838835095936:12345-192.168.201.48@tcp:54:lfs.0 00010000:00010000:0.0:1787032382.213129:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213145:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213155:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213185:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213192:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213200:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213207:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7e600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.213212:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213220:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213232:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:0.0:1787032382.213235:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787032382.213239:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.213256:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e600/0xcd047797ef1eae03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.213326:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:14395:x1873838835095936:12345-192.168.201.48@tcp:54:lfs.0 Request processed in 293us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.213334:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 32 00000100:00100000:0.0:1787032382.215939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.216122:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835096064 00000100:00100000:2.0:1787032382.216131:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835096064 00000100:00100000:2.0:1787032382.216193:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:2.0:1787032382.216204:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:2356:x1873838835096064:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032382.216225:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032382.216253:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0031800/0xcd047797ef1eadf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c8b expref: 19 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.216275:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:2.0:1787032382.216280:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032382.216333:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+18:2356:x1873838835096064:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 131us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.216342:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:3.0:1787032382.218894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.218972:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835096320 00000100:00100000:2.0:1787032382.218981:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835096320 00000100:00100000:2.0:1787032382.219049:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:2.0:1787032382.219058:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+18:14395:x1873838835096320:12345-192.168.201.48@tcp:35:lfs.0 00000100:00100000:2.0:1787032382.219491:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:14395:x1873838835096320:12345-192.168.201.48@tcp:35:lfs.0 Request processed in 432us (605us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787032382.219512:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:0.0:1787032382.556516:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.556640:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835096576 00000100:00100000:2.0:1787032382.556653:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835096576 00000100:00100000:2.0:1787032382.556722:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:2.0:1787032382.556732:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:14426:x1873838835096576:12345-192.168.201.48@tcp:101:cat.0 00010000:00010000:2.0:1787032382.556766:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032382.556791:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c92 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.556919:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.556935:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.556947:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032382.556959:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787032382.557138:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c92 expref: 22 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.557157:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c92 expref: 21 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.557166:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:2.0:1787032382.557170:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787032382.557174:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc7800, rc 0) 00000100:00100000:2.0:1787032382.557265:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+21:14426:x1873838835096576:12345-192.168.201.48@tcp:101:cat.0 Request processed in 533us (760us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787032382.557272:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 33 00000100:00100000:0.0:1787032382.560642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.560794:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835096832 00000100:00100000:1.0:1787032382.560803:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835096832 00000100:00100000:1.0:1787032382.560867:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:1.0:1787032382.560877:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+21:14426:x1873838835096832:12345-192.168.201.48@tcp:35:cat.0 00000100:00100000:1.0:1787032382.561243:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+22:14426:x1873838835096832:12345-192.168.201.48@tcp:35:cat.0 Request processed in 367us (610us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787032382.561264:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 8 00000100:00100000:3.0:1787032382.561896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.562273:0:16254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835096960 00000100:00100000:0.0:1787032382.562278:0:16254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835096960 00000100:00100000:0.0:1787032382.562325:0:16254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:0.0:1787032382.562333:0:16254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+22:2355:x1873838835096960:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032382.562346:0:16254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032382.562370:0:16254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae11 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c92 expref: 22 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.562387:0:16254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:0.0:1787032382.562392:0:16254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032382.562439:0:16254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+21:2355:x1873838835096960:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 107us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.562446:0:16254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:0.0:1787032382.654254:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.658721:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835097216 00000100:00100000:1.0:1787032382.658741:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835097216 00000100:00100000:1.0:1787032382.658999:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 34 00000100:00100000:1.0:1787032382.659021:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+21:14432:x1873838835097216:12345-192.168.201.48@tcp:101:dd.0 00010000:00010000:1.0:1787032382.659047:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787032382.659093:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eae1f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2c99 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.659202:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.659217:0:14237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 22 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.659225:0:14237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 22 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.659233:0:14237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.659275:0:14237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 22 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.659289:0:14237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 22 pid: 14237 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.659304:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14237:1873838857102976:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032382.659455:0:14237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 22 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.659465:0:14237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 22 pid: 14238 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.659474:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdf4874a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14237:1873838857103104:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032382.659498:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff99ccc3165240 going to sleep for 11 seconds 00000100:00100000:2.0:1787032382.665201:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.665340:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14237:1873838857102976:192.168.201.48@tcp:104: 00000100:00100000:1.0:1787032382.665353:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdf4874a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14237:1873838857103104:192.168.201.48@tcp:104: 00010000:00010000:1.0:1787032382.665380:0:14237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032382.665464:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032382.667442:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835097344 00000100:00100000:1.0:1787032382.667456:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835097344 00010000:00010000:1.0:1787032382.667503:0:14222:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 23 pid: 14237 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.667657:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835097472 00000100:00100000:1.0:1787032382.667662:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835097472 00010000:00010000:1.0:1787032382.667677:0:14222:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 24 pid: 14238 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.667707:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:1.0:1787032382.667717:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffab6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:2356:x1873838835097344:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032382.667733:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032382.667754:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 24 pid: 14237 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.667766:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 24 pid: 14237 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.667789:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f800/0xcd047797ef1eadd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c7d expref: 24 pid: 14237 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.667805:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:1.0:1787032382.667811:0:14222:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.667819:0:14222:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.667825:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032382.668235:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffab6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+23:2356:x1873838835097344:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 517us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032382.668244:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:1.0:1787032382.668298:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:1.0:1787032382.668306:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+22:2355:x1873838835097472:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787032382.668314:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787032382.668319:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 22 pid: 14238 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.668328:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 22 pid: 14238 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.668351:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030600/0xcd047797ef1eadc4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c76 expref: 22 pid: 14238 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.668362:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:1.0:1787032382.668366:0:14222:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.668373:0:14222:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.668380:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.668414:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787032382.668436:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+21:2355:x1873838835097472:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 131us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032382.668443:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 12 00010000:00010000:0.0:1787032382.668654:0:14237:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.668663:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032382.668688:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787032382.668862:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030800/0xcd047797ef1eae1f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c99 expref: 22 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.668877:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030c00/0xcd047797ef1eae26 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2c99 expref: 21 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.668885:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:0.0:1787032382.668887:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787032382.668890:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc0030c00, rc 0) 00000100:00100000:0.0:1787032382.668915:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+21:14432:x1873838835097216:12345-192.168.201.48@tcp:101:dd.0 Request processed in 9907us (14671us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787032382.668923:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 34 00000100:00100000:3.0:1787032382.673347:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.673435:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835097728 00000100:00100000:0.0:1787032382.673444:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835097728 00000100:00100000:0.0:1787032382.673507:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 35 00000100:00100000:0.0:1787032382.673527:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+21:14432:x1873838835097728:12345-192.168.201.48@tcp:36:dd.0 00010000:00010000:0.0:1787032382.673799:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.673816:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.673826:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787032382.673894:0:14236:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787032382.673941:0:14236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0dda2e0 reply state 00000000c29f1ad3 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.673950:0:14236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787032382.674386:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14432:x1873838835097728:12345-192.168.201.48@tcp:36:dd.0 Request processed in 868us (1047us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787032382.674394:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 35 00000020:00080000:0.0:1787032382.674410:0:14236:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787032382.676556:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.676572:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.676579:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.676584:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7f600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032382.676588:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.676595:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.676610:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:2.0:1787032382.676613:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032382.676618:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.676624:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eae34 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032382.677880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.677967:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835097856 00000100:00100000:0.0:1787032382.677977:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835097856 00000100:00100000:0.0:1787032382.678044:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:0.0:1787032382.678054:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+23:14432:x1873838835097856:12345-192.168.201.48@tcp:101:dd.0 00010000:00010000:0.0:1787032382.678116:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032382.678137:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2ca0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.678199:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca0 expref: 24 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.678213:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca0 expref: 24 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.678232:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:0.0:1787032382.678234:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032382.678237:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7ee00, rc 0) 00000100:00100000:0.0:1787032382.678288:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14432:x1873838835097856:12345-192.168.201.48@tcp:101:dd.0 Request processed in 235us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.678295:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 36 00000100:00100000:1.0:1787032382.695183:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.695292:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835098112 00000100:00100000:0.0:1787032382.695303:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835098112 00000100:00100000:0.0:1787032382.695424:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:0.0:1787032382.695435:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14432:x1873838835098112:12345-192.168.201.48@tcp:103:dd.0 00010000:00010000:0.0:1787032382.695452:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032382.695479:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca0 expref: 24 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.695498:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:0.0:1787032382.695504:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787032382.695622:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+23:14432:x1873838835098112:12345-192.168.201.48@tcp:103:dd.0 Request processed in 188us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.695630:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:1.0:1787032382.697727:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.697819:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835098240 00000100:00100000:2.0:1787032382.697828:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835098240 00000100:00100000:2.0:1787032382.697899:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:2.0:1787032382.697922:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+23:14432:x1873838835098240:12345-192.168.201.48@tcp:58:dd.0 00010000:00010000:2.0:1787032382.698034:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.698050:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.698061:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787032382.699811:0:14236:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787032382.700274:0:14236:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787032382.700345:0:14236:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787032382.702415:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+23:14432:x1873838835098240:12345-192.168.201.48@tcp:58:dd.0 Request processed in 4473us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.702430:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 37 00000100:00100000:3.0:1787032382.710297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.710393:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835098368 00000100:00100000:2.0:1787032382.710414:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835098368 00000100:00100000:2.0:1787032382.710590:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 38 00000100:00100000:2.0:1787032382.710601:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc3693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+23:14432:x1873838835098368:12345-192.168.201.48@tcp:101:dd.0 00010000:00010000:2.0:1787032382.710622:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032382.710644:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1eae49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2ca7 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.710700:0:14238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.710710:0:14238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1eae49 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca7 expref: 24 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.710745:0:14238:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.710759:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1eae49 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca7 expref: 24 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.710774:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:2.0:1787032382.710777:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787032382.710780:0:14238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1eae49 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca7 expref: 24 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.710788:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6600, rc 0) 00000100:00100000:2.0:1787032382.710977:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc3693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14432:x1873838835098368:12345-192.168.201.48@tcp:101:dd.0 Request processed in 377us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.711057:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 38 00000040:00080000:0.0:1787032382.721801:0:14270:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787032382.721811:0:14270:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032382.721925:0:14270:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787032382.721932:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787032382.722361:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14270:1873838857103232:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787032382.722519:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787032382.728699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.729583:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835098496 00000100:00100000:2.0:1787032382.729595:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835098496 00000100:00100000:2.0:1787032382.729654:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:2.0:1787032382.729664:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+25:14434:x1873838835098496:12345-192.168.201.48@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787032382.729757:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+25:14434:x1873838835098496:12345-192.168.201.48@tcp:900:lhsmtool_posix.0 Request processed in 94us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.729766:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:0.0:1787032382.731012:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14270:1873838857103232:192.168.201.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787032382.732636:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.732749:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835098624 00000100:00100000:2.0:1787032382.732757:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835098624 00000100:00100000:2.0:1787032382.732856:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:2.0:1787032382.732866:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdf4874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14434:x1873838835098624:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787032382.732908:0:14236:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787032382.733054:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdf4874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14434:x1873838835098624:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 189us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.733061:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 39 00000100:00100000:3.0:1787032382.741617:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.741785:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835098752 00000100:00100000:2.0:1787032382.741795:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835098752 00000100:00100000:2.0:1787032382.741865:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:2.0:1787032382.741875:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14434:x1873838835098752:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787032382.741949:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.741965:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.741976:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742050:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742057:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742064:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742114:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742123:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742139:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032382.742176:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787032382.742181:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787032382.742210:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742223:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742241:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742248:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742254:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032382.742258:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742265:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742277:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdcba3a900) 00010000:00010000:2.0:1787032382.742280:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032382.742285:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742292:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eae50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742317:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742323:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742329:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742335:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032382.742338:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742344:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742352:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99cdc3864b00) 00010000:00010000:2.0:1787032382.742354:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032382.742357:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742363:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7800/0xcd047797ef1eae57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742379:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742385:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742390:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742435:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032382.742438:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742443:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742451:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:2.0:1787032382.742453:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787032382.742456:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.742460:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6800/0xcd047797ef1eae5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032382.743867:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14434:x1873838835098752:12345-192.168.201.48@tcp:34:lhsmtool_posix.0 Request processed in 1985us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.743880:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 40 00000100:00100000:3.0:1787032382.748564:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.748703:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835099008 00000100:00100000:2.0:1787032382.748714:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835099008 00000100:00100000:2.0:1787032382.748772:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:2.0:1787032382.748782:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+24:14434:x1873838835099008:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032382.748804:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032382.748827:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eae65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2cae expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.748948:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749000:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749014:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787032382.749027:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787032382.749169:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749177:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749184:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749190:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:2.0:1787032382.749194:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749202:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749214:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:2.0:1787032382.749217:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787032382.749222:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749248:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eae6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749292:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eae65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cae expref: 26 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749311:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99cdcba3a900) 00010000:00010000:2.0:1787032382.749313:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787032382.749317:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eae65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cae expref: 26 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.749327:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6a00, rc 0) 00000100:00100000:2.0:1787032382.749382:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+25:14434:x1873838835099008:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 602us (827us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787032382.749389:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 41 00000100:00100000:1.0:1787032382.754493:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.754743:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835099136 00000100:00100000:2.0:1787032382.754754:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835099136 00000100:00100000:2.0:1787032382.754814:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:2.0:1787032382.754825:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdffe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+25:14434:x1873838835099136:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787032382.754895:0:14238:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787032382.755522:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdffe08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+25:14434:x1873838835099136:12345-192.168.201.48@tcp:53:lhsmtool_posix.0 Request processed in 687us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.755533:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 42 00000100:00100000:1.0:1787032382.761797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.761895:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835099392 00000100:00100000:0.0:1787032382.761906:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835099392 00000100:00100000:0.0:1787032382.761967:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 43 00000100:00100000:0.0:1787032382.761977:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+25:14434:x1873838835099392:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032382.762007:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032382.762029:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae7a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2cb5 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787032382.763042:0:14237:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1787032382.763063:0:14237:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787032382.763143:0:14237:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1787032382.763630:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e000/0xcd047797ef1eae81 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.763645:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e000/0xcd047797ef1eae81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.763658:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e000/0xcd047797ef1eae81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.763718:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae7a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cb5 expref: 28 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.763736:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e000/0xcd047797ef1eae81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cb5 expref: 27 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.763744:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032382.763747:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787032382.763751:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7e000, rc 0) 00000100:00100000:0.0:1787032382.763814:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+27:14434:x1873838835099392:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 1838us (2029us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787032382.763823:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 43 00000100:00100000:1.0:1787032382.776127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.776218:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835099648 00000100:00100000:0.0:1787032382.776231:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835099648 00000100:00100000:0.0:1787032382.776293:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:0.0:1787032382.776304:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+27:14434:x1873838835099648:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787032382.776382:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032382.776425:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e000/0xcd047797ef1eae81 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cb5 expref: 27 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776444:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0af00) 00010000:00010000:0.0:1787032382.776455:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787032382.776478:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776491:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776503:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776533:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776541:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776547:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776628:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776636:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776643:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776655:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7ee00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.776660:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776668:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776677:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99cdc4f0ab00) 00010000:00010000:0.0:1787032382.776680:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032382.776684:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776689:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ee00/0xcd047797ef1eae8f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776699:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776705:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776710:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776715:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7e800 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.776717:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776724:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776743:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x592fc6bc (ffff99cdc4f0a700) 00010000:00010000:0.0:1787032382.776746:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787032382.776749:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.776755:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eae96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x592fc6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.776847:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+26:14434:x1873838835099648:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 533us (718us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787032382.776856:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 44 00000100:00100000:1.0:1787032382.779702:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.780001:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835099776 00000100:00100000:0.0:1787032382.780011:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835099776 00000100:00100000:0.0:1787032382.780108:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:0.0:1787032382.780117:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+26:14434:x1873838835099776:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032382.780138:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032382.780160:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ec00/0xcd047797ef1eae9d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2cbc expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.780198:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eaea4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.780213:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eaea4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.780224:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eaea4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.780324:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ec00/0xcd047797ef1eae9d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cbc expref: 28 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.780348:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7f600/0xcd047797ef1eaea4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cbc expref: 27 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.780358:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:0.0:1787032382.780361:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787032382.780365:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7f600, rc 0) 00000100:00100000:0.0:1787032382.780434:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+27:14434:x1873838835099776:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 317us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.780441:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 45 00000100:00100000:1.0:1787032382.786760:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.786859:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835100032 00000100:00100000:2.0:1787032382.786869:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835100032 00000100:00100000:2.0:1787032382.786926:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 46 00000100:00100000:2.0:1787032382.786937:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+27:14434:x1873838835100032:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787032382.787033:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.787059:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.787116:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787032382.787473:0:14238:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787032382.787483:0:14238:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 537633414878ns, next at 538633412193ns, rc = 0 00000004:00010000:2.0:1787032382.788676:0:14238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c46cca32 reply state 0000000033ea51d2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032382.788690:0:14238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787032382.788864:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+29:14434:x1873838835100032:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 1926us (2113us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787032382.788873:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 46 00010000:00010000:0.0:1787032382.792170:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.792187:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.792195:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.792202:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6a00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.792207:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.792216:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.792243:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:0.0:1787032382.792247:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787032382.792251:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.792270:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6a00/0xcd047797ef1eaeab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.795377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.795997:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835100160 00000100:00100000:2.0:1787032382.796008:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835100160 00000100:00100000:2.0:1787032382.796061:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:2.0:1787032382.796105:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+28:14434:x1873838835100160:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032382.796129:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032382.796151:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2cc3 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.796212:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 29 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.796237:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 29 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.796259:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:2.0:1787032382.796276:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787032382.796280:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6e00, rc 0) 00000100:00100000:2.0:1787032382.796334:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+29:14434:x1873838835100160:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 232us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.796341:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 47 00000100:00100000:1.0:1787032382.801038:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.801375:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835100288 00000100:00100000:2.0:1787032382.801385:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835100288 00000100:00100000:2.0:1787032382.801491:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:2.0:1787032382.801502:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2354:x1873838835100288:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787032382.802527:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2354:x1873838835100288:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 1021us (1491us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787032382.802537:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 12 00000100:00100000:3.0:1787032382.805188:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.805706:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835100544 00000100:00100000:0.0:1787032382.805716:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835100544 00000100:00100000:0.0:1787032382.805779:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:0.0:1787032382.805789:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+29:14434:x1873838835100544:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787032382.806058:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+30:14434:x1873838835100544:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 268us (879us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787032382.806094:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 9 00000100:00100000:1.0:1787032382.809913:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.810057:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835100800 00000100:00100000:2.0:1787032382.810096:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835100800 00000100:00100000:2.0:1787032382.810151:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:2.0:1787032382.810161:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+30:14434:x1873838835100800:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787032382.810291:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+30:14434:x1873838835100800:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 131us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.810298:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 48 00000100:00100000:1.0:1787032382.818651:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.818798:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835100928 00000100:00100000:0.0:1787032382.818810:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835100928 00000100:00100000:0.0:1787032382.818883:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:0.0:1787032382.818893:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+30:14434:x1873838835100928:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787032382.818916:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787032382.818943:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ec00/0xcd047797ef1eaeb9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2cca expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.819319:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eaec0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.819334:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eaec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.819346:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eaec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787032382.819385:0:14237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787032382.819436:0:14237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eaec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.819465:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7ec00/0xcd047797ef1eaeb9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cca expref: 32 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.819485:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eaec0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cca expref: 31 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.819494:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:0.0:1787032382.819497:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787032382.819501:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc1a7e800, rc 0) 00000100:00100000:0.0:1787032382.819579:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+31:14434:x1873838835100928:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 687us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.819587:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 49 00000100:00100000:1.0:1787032382.825427:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.825645:0:16366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835101056 00000100:00100000:2.0:1787032382.825656:0:16366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835101056 00000100:00100000:2.0:1787032382.825751:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:2.0:1787032382.825761:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+6:2355:x1873838835101056:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787032382.825778:0:16366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787032382.825800:0:16366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2cd1 expref: -99 pid: 16366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787032382.825864:0:16366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a83f33e, blocks: 0x1 00010000:00010000:2.0:1787032382.825885:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=537s v=(0 0) 00010000:00010000:2.0:1787032382.825890:0:16366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032382.825900:0:16366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 7 pid: 16366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.825920:0:16366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 7 pid: 16366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.825935:0:16366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdc4cc6800, rc 0) 00000100:00100000:2.0:1787032382.826246:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:2355:x1873838835101056:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 484us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.826254:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:1.0:1787032382.830345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.830425:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835101312 00000100:00100000:0.0:1787032382.830434:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835101312 00000100:00100000:0.0:1787032382.830493:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 50 00000100:00100000:0.0:1787032382.830502:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+31:14434:x1873838835101312:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787032382.830636:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+31:14434:x1873838835101312:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 134us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.830644:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 50 00000100:00100000:1.0:1787032382.834247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.834410:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835101440 00000100:00100000:2.0:1787032382.834420:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835101440 00000100:00100000:2.0:1787032382.834480:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00100000:2.0:1787032382.834491:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+31:14434:x1873838835101440:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787032382.893717:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1787032382.893744:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:3.0:1787032382.893765:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787032382.893809:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787032382.894322:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857103360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787032382.894405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032382.894580:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857103360 00000100:00100000:1.0:1787032382.894588:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857103360 00000100:00100000:1.0:1787032382.894653:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787032382.894661:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857103360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787032382.894829:0:14873:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787032382.894949:0:14873:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787032382.894952:0:14873:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787032382.894954:0:14873:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787032382 -> 1787032382 00002000:00010000:1.0:1787032382.894957:0:14873:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787032382.895152:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1873838857103360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 491us (758us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787032382.895160:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787032382.895210:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99cde481ca80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787032382.895216:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857103360:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787032382.895334:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787032382.895710:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+14:14434:x1873838835101440:12345-192.168.201.48@tcp:44:lhsmtool_posix.0 Request processed in 61216us (61479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.895719:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 51 00000100:00100000:2.0:1787032382.899918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032382.900464:0:14872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835101568 00000100:00100000:0.0:1787032382.900477:0:14872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835101568 00000100:00100000:0.0:1787032382.900643:0:14872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:0.0:1787032382.900654:0:14872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:2357:x1873838835101568:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787032382.900773:0:14872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:2357:x1873838835101568:12345-192.168.201.48@tcp:16:lhsmtool_posix.0 Request processed in 121us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032382.900793:0:14872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:1.0:1787032382.903500:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032382.903657:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835101824 00000100:00100000:3.0:1787032382.903667:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835101824 00000100:00100000:3.0:1787032382.903729:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 52 00000100:00100000:3.0:1787032382.903738:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+14:14434:x1873838835101824:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787032382.903793:0:14237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032382.903820:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc1a7e800/0xcd047797ef1eaec0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cca expref: 14 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.903852:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:3.0:1787032382.903857:0:14237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787032382.903889:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.903903:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.903912:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787032382.904171:0:14237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a512f34d reply state 00000000bbaad04b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032382.904181:0:14237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787032382.904276:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+15:14434:x1873838835101824:12345-192.168.201.48@tcp:36:lhsmtool_posix.0 Request processed in 538us (786us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787032382.904284:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 52 00010000:00010000:3.0:1787032382.907751:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.907772:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.907780:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.907786:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419600 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:3.0:1787032382.907791:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.907798:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.907815:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:3.0:1787032382.907818:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787032382.907823:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.907829:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdef419600/0xcd047797ef1eaece lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.908353:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032382.908634:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835101952 00000100:00100000:3.0:1787032382.908643:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835101952 00000100:00100000:3.0:1787032382.908692:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:3.0:1787032382.908700:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:14434:x1873838835101952:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787032382.908719:0:14873:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787032382.908738:0:14873:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfc6ad379969b2cd8 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.908784:0:14873:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 8 pid: 16366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.908793:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032382.908798:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032382.908802:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 8 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.909733:0:14873:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 8 pid: 16366 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.909754:0:14873:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 8 pid: 16366 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032382.909769:0:14873:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca071c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14873:1873838857103488:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032382.910091:0:14873:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc34a0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787032382.914497:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.914638:0:14873:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca071c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14873:1873838857103488:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032382.914674:0:14873:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 8 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.914709:0:14873:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cdef419a00, rc 0) 00000100:00100000:2.0:1787032382.914777:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+8:14434:x1873838835101952:12345-192.168.201.48@tcp:101:lhsmtool_posix.0 Request processed in 6076us (6427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.914786:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 16 00000100:00100000:0.0:1787032382.915442:0:16254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835102080 00000100:00100000:0.0:1787032382.915450:0:16254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835102080 00010000:00010000:0.0:1787032382.915483:0:16254:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 8 pid: 16366 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.915532:0:16254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:0.0:1787032382.915542:0:16254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4873b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+8:2355:x1873838835102080:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787032382.915556:0:16254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787032382.915580:0:16254:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 8 pid: 16366 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.915593:0:16254:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 8 pid: 16366 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.915617:0:16254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024d11a45/0xcd047797ef1eaec7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd1 expref: 8 pid: 16366 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.915631:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032382.915636:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032382.915642:0:16254:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 7 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.915653:0:16254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 7 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.915703:0:16254:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 7 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.915718:0:16254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16254:1873838857103616:192.168.201.48@tcp:105: 00000100:00100000:0.0:1787032382.915795:0:16254:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787032382.919812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032382.919954:0:16366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835102208 00000100:00100000:3.0:1787032382.919963:0:16366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835102208 00000100:00100000:3.0:1787032382.920027:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:3.0:1787032382.920036:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+8:2355:x1873838835102208:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787032382.920269:0:16366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787032382.920273:0:16366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787032382 00002000:00010000:3.0:1787032382.920275:0:16366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787032381 00002000:00010000:3.0:1787032382.920277:0:16366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787032382 -> 1787032382 00002000:00010000:3.0:1787032382.920280:0:16366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787032382.920341:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:2355:x1873838835102208:12345-192.168.201.48@tcp:2:lhsmtool_posix.0 Request processed in 305us (538us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787032382.920349:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:2.0:1787032382.920812:0:16254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde481ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16254:1873838857103616:192.168.201.48@tcp:105: 00010000:00010000:2.0:1787032382.920844:0:16254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032382.920883:0:16254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4873b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+8:2355:x1873838835102080:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 5342us (6395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.920891:0:16254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 13 00000100:00100000:0.0:1787032382.924748:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032382.924827:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835102336 00000100:00100000:3.0:1787032382.924836:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835102336 00000100:00100000:3.0:1787032382.924903:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032382.924913:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde481ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+8:2354:x1873838835102336:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787032382.924961:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.924993:0:14874:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 8 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.925003:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032382.925007:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787032382.925011:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.925049:0:14874:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 8 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.925063:0:14874:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 8 pid: 14873 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032382.925120:0:14874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca070380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14874:1873838857103744:192.168.201.48@tcp:104: 00000100:00100000:3.0:1787032382.925192:0:14874:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc34a0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787032382.927859:0:14874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca070380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14874:1873838857103744:192.168.201.48@tcp:104: 00010000:00010000:3.0:1787032382.927885:0:14874:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.929352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.929552:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835102464 00000100:00100000:2.0:1787032382.929561:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835102464 00010000:00010000:2.0:1787032382.929601:0:14221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 9 pid: 14873 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032382.929643:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 14 00000100:00100000:2.0:1787032382.929651:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+9:2355:x1873838835102464:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787032382.929666:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787032382.929690:0:14221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 9 pid: 14873 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.929702:0:14221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 9 pid: 14873 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.929723:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0155c73/0xcd047797ef1eaed5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cd8 expref: 9 pid: 14873 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.929753:0:14221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787032382.929757:0:14221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787032382.929763:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.929772:0:14221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.929797:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787032382.929865:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+8:2355:x1873838835102464:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 213us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.929873:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 14 00010000:00010000:3.0:1787032382.930612:0:14874:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.930625:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.930652:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.930661:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.930669:0:14874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.930676:0:14874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032382.930680:0:14874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.930691:0:14874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.930720:0:14874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.930728:0:14874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaedc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032382.930847:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde481ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:2354:x1873838835102336:12345-192.168.201.48@tcp:1:lhsmtool_posix.0 Request processed in 5934us (6108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032382.930856:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:0.0:1787032382.936020:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.936120:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835102720 00000100:00100000:2.0:1787032382.936130:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835102720 00000100:00100000:2.0:1787032382.936193:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 53 00000100:00100000:2.0:1787032382.936202:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+14:14434:x1873838835102720:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787032382.936284:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.936302:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.936314:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.936583:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.936601:0:14238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 15 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.936609:0:14238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.936640:0:14238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 15 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.936654:0:14238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 15 pid: 14236 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032382.936669:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef893100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1873838857103872:192.168.201.48@tcp:104: 00000100:00100000:2.0:1787032382.936749:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdff75c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787032382.943752:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef893100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1873838857103872:192.168.201.48@tcp:104: 00010000:00010000:2.0:1787032382.943785:0:14238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.945262:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032382.945560:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835102848 00000100:00100000:3.0:1787032382.945568:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835102848 00010000:00010000:3.0:1787032382.945613:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 16 pid: 14236 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032382.945657:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 15 00000100:00100000:3.0:1787032382.945667:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+16:2354:x1873838835102848:12345-192.168.201.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787032382.945686:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787032382.945694:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 16 pid: 14236 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.945708:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 16 pid: 14236 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.945734:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6e00/0xcd047797ef1eaeb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2cc3 expref: 16 pid: 14236 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.945773:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:3.0:1787032382.945778:0:14223:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.945788:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.945796:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032382.945828:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787032382.945903:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+15:2354:x1873838835102848:12345-192.168.201.48@tcp:103:ldlm_bl.0 Request processed in 237us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032382.945911:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 15 00010000:00010000:1.0:1787032382.947251:0:14238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.947264:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787032382.947472:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787032382.947654:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787032382.947704:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787032382.947804:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14238:1873838857104000:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787032382.947943:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032382.947977:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cdc893a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787032382.948343:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857104000 00000100:00100000:3.0:1787032382.948352:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857104000 00000100:00100000:3.0:1787032382.948406:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787032382.948415:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1873838857104000:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787032382.948491:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1873838857104000:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032382.948498:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787032382.948651:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14238:1873838857104000:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787032382.949422:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787032382.949497:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef001f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14238:1873838857104128:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787032382.950119:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032382.950146:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787032382.950673:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857104128 00000100:00100000:3.0:1787032382.950681:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857104128 00000100:00100000:3.0:1787032382.950724:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787032382.950732:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1873838857104128:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787032382.950938:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14238:x1873838857104128:12345-0@lo:1000:mdt00_002.0 Request processed in 206us (821us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787032382.950956:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787032382.951578:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef001f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14238:1873838857104128:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787032382.951621:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951632:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951640:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951646:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6200 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.951658:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951667:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951683:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:0.0:1787032382.951686:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032382.951690:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951697:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6200/0xcd047797ef1eaeea lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951727:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951734:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951739:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951743:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:0.0:1787032382.951746:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951752:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951759:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:0.0:1787032382.951762:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787032382.951775:0:14238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1eae49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca7 expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951787:0:14238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1eae49 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca7 expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951796:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1eae49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca7 expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032382.951862:0:14238:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6600/0xcd047797ef1eae49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.48@tcp remote: 0xfc6ad379969b2ca7 expref: 18 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032382.951876:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdef000000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1873838857104256:192.168.201.48@tcp:105: 00000100:00100000:0.0:1787032382.951944:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff99cde4b2ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787032382.958291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.958384:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835102976 00000100:00100000:2.0:1787032382.958401:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835102976 00000100:00100000:2.0:1787032382.958462:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:2.0:1787032382.958472:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdc76e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:14432:x1873838835102976:12345-192.168.201.48@tcp:49:dd.0 00000100:00100000:2.0:1787032382.958626:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdc76e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:14432:x1873838835102976:12345-192.168.201.48@tcp:49:dd.0 Request processed in 155us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032382.958635:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 10 00000100:00100000:1.0:1787032382.958768:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdef000000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1873838857104256:192.168.201.48@tcp:105: 00010000:00010000:1.0:1787032382.958794:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958804:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7c00/0xcd047797ef1eae42 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958855:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958875:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958886:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958895:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958901:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958907:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958912:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030e00 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032382.958916:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958935:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958947:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:1.0:1787032382.958950:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787032382.958953:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958958:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc0030e00/0xcd047797ef1eaef1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958967:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958972:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958977:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958981:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc6400 already unused, calling callback (ffffffffc1f7d4f0) 00010000:00010000:1.0:1787032382.958984:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958989:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.958995:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99cdce1ffe00) 00010000:00010000:1.0:1787032382.958997:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787032382.959000:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.959016:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc6400/0xcd047797ef1eaee3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032382.959255:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+18:14434:x1873838835102720:12345-192.168.201.48@tcp:57:lhsmtool_posix.0 Request processed in 23053us (23253us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787032382.959263:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 53 00000020:00080000:1.0:1787032382.959267:0:14238:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787032382.959788:0:14270:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787032382.959793:0:14270:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787032382.959820:0:14270:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787032382.959824:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787032382.963250:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032382.963357:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835103232 00000100:00100000:2.0:1787032382.963378:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835103232 00000100:00100000:2.0:1787032382.963438:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 11 00000100:00100000:2.0:1787032382.963447:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cde4872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+18:14434:x1873838835103232:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787032382.964408:0:14240:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787032382.964516:0:14240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787032382.964565:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.964582:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.964593:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.964603:0:14240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.964611:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.964617:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032382.965293:0:14240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787032382.965409:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cde4872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+20:14434:x1873838835103232:12345-192.168.201.48@tcp:35:lhsmtool_posix.0 Request processed in 1949us (2156us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787032382.965419:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 11 00000020:00080000:2.0:1787032382.965426:0:14240:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787032382.967989:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787032382.968004:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.968022:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032382.968027:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.968035:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.968053:0:14225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99cdc4f0ac00) 00010000:00010000:1.0:1787032382.968057:0:14225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787032382.968063:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.968094:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cdc4cc7000/0xcd047797ef1eaef8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032382.968116:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032382.968118:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787032382.968120:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787032383.113509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032383.113622:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835103360 00000100:00100000:1.0:1787032383.113632:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835103360 00000100:00100000:1.0:1787032383.113720:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:1.0:1787032383.113732:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:2356:x1873838835103360:12345-192.168.201.48@tcp:4:dd.0 00002000:00010000:1.0:1787032383.113787:0:14877:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a83f33e, atime: 0x6a83f33d, ctime: 0x6a83f33e, blocks: 0x1 00010000:00010000:1.0:1787032383.113796:0:14877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.113814:0:14877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1787032383.113819:0:14877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032383.113826:0:14877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787032383.114025:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787032383.114092:0:14877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032383.122463:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032383.122556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:3.0:1787032383.123035:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:2.0:1787032383.126226:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787032383.127144:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:1.0:1787032383.127315:0:14879:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787032383.128546:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787032383.128781:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835103488 00000100:00100000:0.0:1787032383.128790:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835103488 00000100:00100000:0.0:1787032383.128943:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787032383.128951:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835103744 00000100:00100000:0.0:1787032383.128954:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835103744 00000100:00100000:0.0:1787032383.128968:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787032383.128971:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835103616 00000100:00100000:0.0:1787032383.128973:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835103616 00000100:00100000:2.0:1787032383.129526:0:16369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:2.0:1787032383.129547:0:16369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+11:2356:x1873838835103488:12345-192.168.201.48@tcp:4:dd.0 00010000:00010000:2.0:1787032383.129591:0:16369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.129609:0:16369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032383.129613:0:16369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032383.129619:0:16369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.129633:0:16369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032383.132824:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787032383.132936:0:14878:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1787032383.134033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032383.134123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032383.134159:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032383.134188:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835103872 00000100:00100000:0.0:1787032383.134197:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835103872 00000100:00100000:0.0:1787032383.134245:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787032383.134251:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835104000 00000100:00100000:0.0:1787032383.134253:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835104000 00000100:00100000:0.0:1787032383.134262:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787032383.134265:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835104128 00000100:00100000:0.0:1787032383.134267:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835104128 00000100:00100000:0.0:1787032383.134275:0:14878:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787032383.134278:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835104256 00000100:00100000:0.0:1787032383.134280:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835104256 00000100:00100000:0.0:1787032383.134659:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:0.0:1787032383.134670:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+16:2356:x1873838835103744:12345-192.168.201.48@tcp:4:dd.0 00010000:00010000:0.0:1787032383.134708:0:16370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.134726:0:16370:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032383.134730:0:16370:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787032383.134737:0:16370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.134751:0:16370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032383.136116:0:14879:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1787032383.139260:0:16371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:1.0:1787032383.139277:0:16371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+16:2357:x1873838835103616:12345-192.168.201.48@tcp:4:dd.0 00010000:00010000:1.0:1787032383.139316:0:16371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.139333:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032383.139337:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032383.139343:0:16371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.139369:0:16371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.237379:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787032383.239137:0:16369:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787032383.239146:0:16369:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1787032383.241226:0:16369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.241255:0:16369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.241267:0:16369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787032383.244003:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1787032383.244027:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1787032383.244034:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1787032383.244064:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:2.0:1787032383.248625:0:14877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.248646:0:14877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.248655:0:14877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.248662:0:14877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:2.0:1787032383.248667:0:14877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.248677:0:14877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.248723:0:14877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.248731:0:14877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6149f41/0xcd047797ef1eaeff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787032383.249115:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+19:2356:x1873838835103360:12345-192.168.201.48@tcp:4:dd.0 Request processed in 135380us (135609us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787032383.249127:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 0 00000100:00100000:2.0:1787032383.249166:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 4 00000100:00100000:2.0:1787032383.249177:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+18:2357:x1873838835103872:12345-192.168.201.48@tcp:4:dd.0 00010000:00010000:2.0:1787032383.249214:0:14877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.249227:0:14877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787032383.249232:0:14877:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787032383.249238:0:14877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787032383.249250:0:14877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.249742:0:16369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7e00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032383.249750:0:16369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.249760:0:16369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.249774:0:16369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.249782:0:16369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000664bed0/0xcd047797ef1eaf06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032383.249984:0:16369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+18:2356:x1873838835103488:12345-192.168.201.48@tcp:4:dd.0 Request processed in 120427us (127519us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787032383.249992:0:16369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 1 00000100:00100000:1.0:1787032383.250013:0:16369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 5 00000100:00100000:1.0:1787032383.250022:0:16369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+17:2357:x1873838835104000:12345-192.168.201.48@tcp:4:dd.0 00010000:00010000:1.0:1787032383.250042:0:16369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.250052:0:16369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032383.250055:0:16369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032383.250060:0:16369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.250095:0:16369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787032383.323689:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:0.0:1787032383.323711:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1787032383.323954:0:16370:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:3.0:1787032383.323959:0:16370:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:3.0:1787032383.323977:0:16370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.323991:0:16370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.324000:0:16370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.324018:0:16370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc1a7e600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:3.0:1787032383.324024:0:16370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.324034:0:16370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.324055:0:16370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.324097:0:16370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089cc3a9a/0xcd047797ef1eaf0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.324267:0:16371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.324275:0:16371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.324282:0:16371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.324299:0:16371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030000 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032383.324302:0:16371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.324309:0:16371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.324322:0:16371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.324329:0:16371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ad395f9/0xcd047797ef1eaf14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787032383.324409:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+16:2356:x1873838835103744:12345-192.168.201.48@tcp:4:dd.0 Request processed in 189735us (201847us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787032383.324439:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 2 00000100:00100000:3.0:1787032383.324473:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 6 00000100:00100000:3.0:1787032383.324484:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+15:2356:x1873838835104128:12345-192.168.201.48@tcp:4:dd.0 00010000:00010000:3.0:1787032383.324514:0:16370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.324526:0:16370:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032383.324531:0:16370:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787032383.324538:0:16370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787032383.324550:0:16370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032383.325694:0:16371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+16:2357:x1873838835103616:12345-192.168.201.48@tcp:4:dd.0 Request processed in 186414us (202651us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787032383.325706:0:16371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 3 00000100:00100000:1.0:1787032383.325732:0:16371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 7 00000100:00100000:1.0:1787032383.325744:0:16371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+15:2356:x1873838835104256:12345-192.168.201.48@tcp:4:dd.0 00010000:00010000:1.0:1787032383.325771:0:16371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.325783:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032383.325786:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787032383.325791:0:16371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.326746:0:16371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787032383.395301:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:2.0:1787032383.395327:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1787032383.399959:0:16369:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1787032383.399969:0:16369:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 16391 00010000:00010000:1.0:1787032383.399984:0:16369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.399998:0:16369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400007:0:16369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400014:0:16369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0031600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032383.400019:0:16369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400028:0:16369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400048:0:16369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400057:0:16369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd5a404/0xcd047797ef1eaf22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032383.400200:0:16369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+15:2357:x1873838835104000:12345-192.168.201.48@tcp:4:dd.0 Request processed in 150175us (266169us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787032383.400210:0:16369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 5 00010000:00010000:1.0:1787032383.400263:0:14877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400272:0:14877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400279:0:14877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400285:0:14877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc4cc7c00 already unused, calling callback (ffffffffc153f220) 00010000:00010000:1.0:1787032383.400288:0:14877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400296:0:14877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400308:0:14877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787032383.400315:0:14877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d6a592/0xcd047797ef1eaf1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787032383.400359:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+13:2357:x1873838835103872:12345-192.168.201.48@tcp:4:dd.0 Request processed in 151186us (273223us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787032383.400366:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 4 00000001:00080000:2.0:1787032383.452542:0:7500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1787032383.452676:0:16370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.452693:0:16370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.452702:0:16370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.452709:0:16370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdef419600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032383.452715:0:16370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.452724:0:16370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.452746:0:16370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.452754:0:16370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a23b85e/0xcd047797ef1eaf29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032383.453408:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+7:2356:x1873838835104128:12345-192.168.201.48@tcp:4:dd.0 Request processed in 128919us (319275us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787032383.453420:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 6 00010000:00010000:0.0:1787032383.456927:0:16371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.456947:0:16371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.456957:0:16371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.456965:0:16371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cdc0030600 already unused, calling callback (ffffffffc153f220) 00010000:00010000:0.0:1787032383.456980:0:16371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.456990:0:16371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.457011:0:16371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787032383.457019:0:16371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002102dde0/0xcd047797ef1eaf30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787032383.457149:0:16371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2356:x1873838835104256:12345-192.168.201.48@tcp:4:dd.0 Request processed in 131405us (322984us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787032383.457160:0:16371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 7 00010000:00010000:1.0:1787032384.257583:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787032384.257703:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857104768:0@lo:400:kworker.0 00000100:00100000:1.0:1787032384.257796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032384.257893:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787032384.257908:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857104640:0@lo:400:kworker.0 00000100:00100000:1.0:1787032384.257945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032384.257968:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff62dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857105152:0@lo:400:kworker.0 00000100:00100000:1.0:1787032384.257995:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787032384.258029:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857105152 00000100:00100000:1.0:1787032384.258038:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857105152 00000100:00100000:3.0:1787032384.258575:0:16366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857104768 00000100:00100000:3.0:1787032384.258581:0:16366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857104768 00000100:00100000:3.0:1787032384.258668:0:16366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857104640 00000100:00100000:3.0:1787032384.258672:0:16366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857104640 00000100:00100000:3.0:1787032384.258699:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787032384.258708:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857104768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032384.258813:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857104768:12345-0@lo:400:kworker.0 Request processed in 105us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032384.258822:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787032384.258999:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787032384.259010:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857105152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787032384.259120:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857104384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787032384.259153:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787032384.259164:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857104640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032384.259291:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cde4873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857104512:0@lo:400:kworker.0 00000100:00100000:3.0:1787032384.259344:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857104640:12345-0@lo:400:kworker.0 Request processed in 183us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032384.259351:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787032384.259383:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787032384.259390:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787032384.259392:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787032384.259436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787032384.259556:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857104640:0@lo:400:kworker.0 00000100:00100000:0.0:1787032384.262739:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857104896:0@lo:400:kworker.0 00000100:00100000:0.0:1787032384.262826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787032384.262906:0:16013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857104384 00000100:00100000:0.0:1787032384.262915:0:16013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857104384 00000100:00100000:0.0:1787032384.262983:0:16013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787032384.262992:0:16013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857104384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787032384.263041:0:16013:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1787032384.263107:0:16013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1873838857104384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032384.263115:0:16013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787032384.263209:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873838857105152:12345-0@lo:400:kworker.0 Request processed in 4191us (5202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032384.263224:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787032384.263273:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857104896 00000100:00100000:1.0:1787032384.263281:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857104896 00000100:00100000:1.0:1787032384.263335:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787032384.263343:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857104896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787032384.263420:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1873838857104896:12345-0@lo:400:kworker.0 Request processed in 77us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787032384.263448:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787032384.263662:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787032384.263669:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99cde481ca80, transno 8589934595 00000004:00080000:1.0:1787032384.263684:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787032384.263722:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1873838857104384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787032384.263739:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1873838857104896:0@lo:400:kworker.0 00000100:00100000:3.0:1787032384.264152:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff62dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1873838857105152:0@lo:400:kworker.0 00000100:00100000:3.0:1787032384.264168:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857104768:0@lo:400:kworker.0 00000100:00100000:2.0:1787032384.264327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032384.264399:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdff62fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857105024:0@lo:400:kworker.0 00000100:00100000:2.0:1787032384.264439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787032384.264492:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857105024 00000100:00100000:2.0:1787032384.264498:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857105024 00000100:00100000:2.0:1787032384.264547:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787032384.264555:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857105024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787032384.264597:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873838857105024:12345-0@lo:400:kworker.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032384.264605:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787032384.264630:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787032384.264652:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdff62fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1873838857105024:0@lo:400:kworker.0 00000100:00100000:3.0:1787032384.264744:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857104512 00000100:00100000:3.0:1787032384.264749:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857104512 00000100:00100000:3.0:1787032384.264788:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787032384.264795:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdca8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3305:x1873838857104512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787032384.265305:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdca8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b69d5fe-062a-4046-aadd-ee94584b57f2+19:3305:x1873838857104512:12345-0@lo:400:kworker.0 Request processed in 508us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032384.265313:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787032384.265781:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cde4873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8b69d5fe-062a-4046-aadd-ee94584b57f2:3305:1873838857104512:0@lo:400:kworker.0 00000100:00100000:1.0:1787032385.285292:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff99cdca073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857105280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787032385.285467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787032385.285654:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787032385.285756:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838857105280 00000100:00100000:0.0:1787032385.285768:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838857105280 00000100:00100000:0.0:1787032385.285846:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787032385.285858:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdff62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857105280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787032385.285907:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787032385.297622:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdff62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873838857105280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11749us (12138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032385.297642:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787032385.300704:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff99cdca073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1873838857105280:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787032385.476966:0:16410:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1787032386.178352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032386.178401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032386.178432:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032386.178467:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032386.178495:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032386.178516:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032386.178552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.48@tcp (source: 12345-192.168.201.48@tcp) 00000100:00100000:0.0:1787032386.178580:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835104640 00000100:00100000:0.0:1787032386.178590:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835104640 00000100:00100000:0.0:1787032386.178679:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835105152 00000100:00100000:0.0:1787032386.178682:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835105152 00000100:00100000:0.0:1787032386.178697:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835104768 00000100:00100000:0.0:1787032386.178699:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835104768 00000100:00100000:0.0:1787032386.178709:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835105024 00000100:00100000:0.0:1787032386.178711:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835105024 00000100:00100000:0.0:1787032386.178740:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:0.0:1787032386.178751:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2357:x1873838835104640:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032386.178883:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032386.178894:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2357:x1873838835105152:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032386.178967:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2357:x1873838835105152:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 75us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032386.178982:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 18 00000100:00100000:3.0:1787032386.179001:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:3.0:1787032386.179007:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2357:x1873838835104768:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032386.179033:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2357:x1873838835104768:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032386.179039:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 19 00000100:00100000:3.0:1787032386.179050:0:16366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:3.0:1787032386.179056:0:16366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2357:x1873838835105024:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032386.179114:0:16366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1efce990-7f6d-4d80-b404-6b6f14248bce+5:2357:x1873838835105024:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 58us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032386.179121:0:16366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 20 00000100:00100000:3.0:1787032386.179273:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835104896 00000100:00100000:3.0:1787032386.179278:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835104896 00000100:00100000:3.0:1787032386.179306:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835104512 00000100:00100000:3.0:1787032386.179309:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835104512 00000100:00100000:3.0:1787032386.179325:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:3.0:1787032386.179330:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2357:x1873838835104896:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032386.179380:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1efce990-7f6d-4d80-b404-6b6f14248bce+6:2357:x1873838835104896:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 48us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032386.179386:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 27 00000100:00100000:3.0:1787032386.179398:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00100000:3.0:1787032386.179403:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+20:2357:x1873838835104512:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:3.0:1787032386.179425:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+20:2357:x1873838835104512:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 22us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787032386.179437:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 28 00000100:00080000:3.0:1787032386.179459:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787032386.179465:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787032386.179467:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787032386.179974:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef000a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca9b6b7-6411-4328-8f1f-ee2f6964ea5e+5:2357:x1873838835104640:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 1218us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787032386.179983:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 17 00000100:00100000:2.0:1787032386.181285:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873838835104384 00000100:00100000:2.0:1787032386.181295:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873838835104384 00000100:00100000:2.0:1787032386.181353:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.48@tcp, seq: 121 00000100:00100000:2.0:1787032386.181361:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cdef89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:2357:x1873838835104384:12345-192.168.201.48@tcp:400:kworker.0 00000100:00100000:2.0:1787032386.181427:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cdef89b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:12a2a834-3f08-4bf2-9411-438402fb4594+13:2357:x1873838835104384:12345-192.168.201.48@tcp:400:kworker.0 Request processed in 66us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787032386.181434:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.48@tcp, seq: 121 00010000:00010000:3.0:1787032386.305260:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29626 lines, 29626 kept, 0 dropped, 0 bad.